2024-04-25T15:13:45.867 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T15:13:45.867 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205 --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --owner scheduled_pdonnell@teuthology --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs/{frag test}} -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/orig.config.yaml 2024-04-25T15:13:45.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T15:13:46.011 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs/{frag test}} email: pdonnell@redhat.com first_in_suite: false job_id: '7673205' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN2IE4umLPQgjAXP/4LUoszakM1pKwXoDlm4PCOR++AzahIueafSNGLT1goeK7oExyTvYBz6EGs6GTJS/N5Au8I= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiNR0sBCz6RKkA6AarxVmSGhVhS9zq34mYb+mHOmyoYmLiCIeg5VZTGWoeLOgEkkQRutixUcGYlsq+xbiE6Zvk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - check-counter: counters: mds: - mds.dir_split - workunit: clients: client.0: - libcephfs/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T15:13:46.011 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T15:13:46.012 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T15:13:46.012 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T15:13:46.014 INFO:teuthology.task.internal:Checking packages... 2024-04-25T15:13:46.043 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T15:13:46.043 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T15:13:46.043 INFO:teuthology.packaging:ref: None 2024-04-25T15:13:46.043 INFO:teuthology.packaging:tag: None 2024-04-25T15:13:46.043 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:13:46.043 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:13:46.043 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:13:46.266 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T15:13:46.268 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T15:13:46.275 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T15:13:46.276 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T15:13:46.288 INFO:teuthology.task.internal:Saving configuration 2024-04-25T15:13:46.307 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T15:13:46.315 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T15:13:46.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:07:59.919955', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN2IE4umLPQgjAXP/4LUoszakM1pKwXoDlm4PCOR++AzahIueafSNGLT1goeK7oExyTvYBz6EGs6GTJS/N5Au8I='} 2024-04-25T15:13:46.365 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 15:07:59.917562', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiNR0sBCz6RKkA6AarxVmSGhVhS9zq34mYb+mHOmyoYmLiCIeg5VZTGWoeLOgEkkQRutixUcGYlsq+xbiE6Zvk='} 2024-04-25T15:13:46.365 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T15:13:46.371 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T15:13:46.371 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T15:13:46.371 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T15:13:46.442 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd3cea21e50>, signals=[15]) 2024-04-25T15:13:46.442 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T15:13:46.449 INFO:teuthology.task.internal:Opening connections... 2024-04-25T15:13:46.449 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:13:46.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:13:46.533 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:13:46.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:13:46.609 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T15:13:46.618 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-04-25T15:13:46.638 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-04-25T15:13:46.638 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="9" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="9" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el9" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:LOGO="fedora-logo-icon" 2024-04-25T15:13:46.696 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T15:13:46.697 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2024-04-25T15:13:46.697 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T15:13:46.697 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T15:13:46.697 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T15:13:46.697 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-04-25T15:13:46.721 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-04-25T15:13:46.739 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-04-25T15:13:46.739 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T15:13:46.796 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-04-25T15:13:46.797 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T15:13:46.797 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T15:13:46.797 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T15:13:46.797 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-04-25T15:13:46.821 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T15:13:46.830 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T15:13:46.856 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T15:13:46.857 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:13:46.859 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-04-25T15:13:46.876 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T15:13:46.883 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T15:13:46.884 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:13:46.918 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-04-25T15:13:47.061 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T15:13:47.147 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T15:13:47.170 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T15:13:47.171 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T15:13:47.171 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:13:47.172 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T15:13:47.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:13:47.190 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-04-25T15:13:47.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:13:47.192 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-04-25T15:13:47.248 INFO:teuthology.orchestra.run.smithi155.stdout:5.14.0-437.el9.x86_64 2024-04-25T15:13:47.248 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.14.0-437.el9.x86_64 2024-04-25T15:13:47.248 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum install -y kernel 2024-04-25T15:13:47.251 INFO:teuthology.orchestra.run.smithi033.stdout:5.14.0-437.el9.x86_64 2024-04-25T15:13:47.252 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.14.0-437.el9.x86_64 2024-04-25T15:13:47.252 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2024-04-25T15:13:49.570 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T15:13:49.619 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T15:13:51.894 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-25T15:13:52.263 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-25T15:13:56.054 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T15:13:56.655 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-04-25T15:13:57.644 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-25T15:13:58.162 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-04-25T15:13:59.164 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-25T15:14:00.332 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-25T15:14:04.186 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-25T15:14:05.654 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T15:14:06.109 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T15:14:06.109 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T15:14:06.204 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-25T15:14:06.205 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-25T15:14:06.205 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-25T15:14:06.312 DEBUG:teuthology.orchestra.run.smithi155:> echo no | sudo yum reinstall kernel || true 2024-04-25T15:14:06.812 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 03:14:04 PM UTC. 2024-04-25T15:14:06.940 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-25T15:14:06.955 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout:Reinstalling: 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 255 k 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 0 2024-04-25T15:14:06.956 INFO:teuthology.orchestra.run.smithi155.stderr:Operation aborted. 2024-04-25T15:14:07.019 INFO:teuthology.orchestra.run.smithi155.stdout:Is this ok [y/N]: 2024-04-25T15:14:07.019 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum reinstall -y kernel || true 2024-04-25T15:14:07.513 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:14:04 PM UTC. 2024-04-25T15:14:07.619 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T15:14:07.619 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T15:14:07.628 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout:Reinstalling: 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T15:14:07.629 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:14:07.630 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 255 k 2024-04-25T15:14:07.630 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 0 2024-04-25T15:14:07.630 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-25T15:14:07.715 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-04-25T15:14:07.716 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-04-25T15:14:07.716 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-04-25T15:14:07.809 DEBUG:teuthology.orchestra.run.smithi033:> echo no | sudo yum reinstall kernel || true 2024-04-25T15:14:07.921 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.1 MB/s | 255 kB 00:00 2024-04-25T15:14:07.922 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:14:07.922 INFO:teuthology.orchestra.run.smithi155.stdout:Total 871 kB/s | 255 kB 00:00 2024-04-25T15:14:07.943 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-25T15:14:08.129 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-25T15:14:08.129 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-25T15:14:08.134 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-25T15:14:08.134 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-25T15:14:08.273 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-25T15:14:08.331 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 03:14:05 PM UTC. 2024-04-25T15:14:08.364 INFO:teuthology.orchestra.run.smithi155.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:14:08.364 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:14:08.455 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalling: 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 255 k 2024-04-25T15:14:08.464 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 0 2024-04-25T15:14:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:Operation aborted. 2024-04-25T15:14:08.515 INFO:teuthology.orchestra.run.smithi033.stdout:Is this ok [y/N]: 2024-04-25T15:14:08.515 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum reinstall -y kernel || true 2024-04-25T15:14:08.999 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:14:08.999 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:14:09.031 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 03:14:05 PM UTC. 2024-04-25T15:14:09.151 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-04-25T15:14:09.152 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-04-25T15:14:09.152 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-04-25T15:14:09.152 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-04-25T15:14:09.152 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalling: 2024-04-25T15:14:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T15:14:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:14:09.153 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-04-25T15:14:09.153 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-04-25T15:14:09.153 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:14:09.153 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 255 k 2024-04-25T15:14:09.153 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 0 2024-04-25T15:14:09.153 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-04-25T15:14:09.639 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-437.el9.x86_64.rpm 902 kB/s | 255 kB 00:00 2024-04-25T15:14:09.640 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:14:09.640 INFO:teuthology.orchestra.run.smithi033.stdout:Total 523 kB/s | 255 kB 00:00 2024-04-25T15:14:09.660 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-04-25T15:14:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:14:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:14:09.665 INFO:teuthology.orchestra.run.smithi155.stdout:Reinstalled: 2024-04-25T15:14:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T15:14:09.665 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:14:09.665 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-25T15:14:09.843 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-04-25T15:14:09.843 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-04-25T15:14:09.848 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-04-25T15:14:09.848 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-04-25T15:14:09.859 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T15:14:09.906 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T15:14:09.906 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T15:14:09.906 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T15:14:09.906 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T15:14:09.906 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T15:14:09.934 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2024-04-25T15:14:09.968 DEBUG:teuthology.parallel:result is None 2024-04-25T15:14:09.994 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-04-25T15:14:10.065 INFO:teuthology.orchestra.run.smithi033.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:14:10.065 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:14:10.724 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:14:10.725 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T15:14:11.374 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T15:14:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:14:11.375 INFO:teuthology.orchestra.run.smithi033.stdout:Reinstalled: 2024-04-25T15:14:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T15:14:11.375 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:14:11.375 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-04-25T15:14:11.536 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T15:14:11.583 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T15:14:11.584 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T15:14:11.584 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T15:14:11.585 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T15:14:11.585 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T15:14:11.624 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2024-04-25T15:14:11.646 DEBUG:teuthology.parallel:result is None 2024-04-25T15:14:11.647 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T15:14:11.663 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T15:14:11.663 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:14:11.689 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T15:14:11.707 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T15:14:11.714 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T15:14:11.727 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T15:14:11.727 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:14:11.744 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T15:14:11.774 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T15:14:11.780 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T15:14:11.781 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:14:11.810 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T15:14:11.841 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:14:11.850 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:14:11.853 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:14:11.863 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T15:14:11.865 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T15:14:11.873 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T15:14:11.873 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:14:11.895 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T15:14:11.931 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T15:14:11.940 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T15:14:11.941 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:14:11.960 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T15:14:11.988 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:14:12.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:14:12.099 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:14:12.176 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:14:12.220 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:14:12.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:14:12.284 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:14:12.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T15:14:12.376 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:14:12.459 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T15:14:12.499 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:14:12.499 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T15:14:12.562 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-04-25T15:14:12.564 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-04-25T15:14:12.598 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:14:12.647 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:14:13.053 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T15:14:13.061 INFO:teuthology.task.internal:Starting timer... 2024-04-25T15:14:13.061 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T15:14:13.121 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T15:14:13.131 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T15:14:13.131 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-04-25T15:14:13.176 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-04-25T15:14:13.178 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-04-25T15:14:13.227 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-04-25T15:14:13.229 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T15:14:13.229 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-04-25T15:14:13.256 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-04-25T15:14:13.256 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-04-25T15:14:13.278 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-04-25T15:14:13.278 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive'} 2024-04-25T15:14:13.278 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:14:13.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:14:13.321 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:14:13.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:14:13.345 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T15:14:13.346 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-04-25T15:14:13.386 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-04-25T15:14:13.422 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T15:14:13.433 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T15:14:13.451 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T15:14:13.452 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T15:17:44.862 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2024-04-25T15:17:44.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-04-25T15:17:44.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:17:44.946 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-04-25T15:17:45.035 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-04-25T15:17:45.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T15:17:45.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T15:17:45.111 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-04-25T15:17:45.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T15:17:45.190 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T15:17:45.201 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T15:17:45.201 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:17:45.201 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:17:45.204 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T15:17:45.204 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:17:45.235 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T15:17:45.249 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T15:17:45.257 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T15:17:45.270 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T15:17:45.273 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-04-25T15:17:45.285 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-04-25T15:17:45.292 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-04-25T15:17:45.299 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T15:17:45.303 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-04-25T15:17:45.312 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T15:17:45.316 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T15:17:45.329 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T15:17:45.365 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:17:45.369 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:17:45.369 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-04-25T15:17:45.369 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:17:45.369 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:17:45.369 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:17:45.369 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:17:45.387 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:17:45.391 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:17:45.391 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-04-25T15:17:45.391 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:17:45.391 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:17:45.391 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:17:45.391 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:17:45.391 INFO:teuthology.run_tasks:Running task install... 2024-04-25T15:17:45.400 DEBUG:teuthology.task.install:project ceph 2024-04-25T15:17:45.400 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T15:17:45.400 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T15:17:45.400 INFO:teuthology.task.install:Using flavor: default 2024-04-25T15:17:45.406 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T15:17:45.406 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T15:17:45.407 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T15:17:45.407 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:17:45.409 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T15:17:45.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:17:45.559 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T15:17:45.559 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T15:17:45.561 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T15:17:45.561 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T15:17:45.817 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T15:17:45.817 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:17:45.818 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T15:17:45.833 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T15:17:45.834 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:17:45.834 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T15:17:45.842 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T15:17:45.842 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T15:17:45.860 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T15:17:45.861 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T15:17:45.907 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T15:17:45.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T15:17:45.981 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T15:17:46.004 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T15:17:46.043 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-04-25T15:17:46.045 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-04-25T15:17:46.069 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-04-25T15:17:46.070 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-04-25T15:17:46.270 INFO:teuthology.orchestra.run.smithi155.stdout:48 files removed 2024-04-25T15:17:46.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T15:17:46.304 INFO:teuthology.orchestra.run.smithi033.stdout:48 files removed 2024-04-25T15:17:46.332 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T15:17:47.064 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 165 kB/s | 84 kB 00:00 2024-04-25T15:17:47.168 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 148 kB/s | 84 kB 00:00 2024-04-25T15:17:47.415 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 38 kB/s | 12 kB 00:00 2024-04-25T15:17:47.544 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-04-25T15:17:47.874 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-04-25T15:17:47.994 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-04-25T15:17:48.634 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T15:17:48.780 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-25T15:17:50.911 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-25T15:17:50.957 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-25T15:17:55.499 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.2 MB 00:00 2024-04-25T15:17:55.553 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.2 MB 00:01 2024-04-25T15:17:57.206 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-25T15:17:57.359 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-04-25T15:17:58.805 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T15:17:59.890 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 21 MB 00:02 2024-04-25T15:18:03.861 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-25T15:18:05.140 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-25T15:18:06.004 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:18:06.004 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:18:06.015 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T15:18:06.016 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T15:18:06.017 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T15:18:06.018 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T15:18:06.020 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T15:18:06.022 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T15:18:06.023 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T15:18:06.084 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-25T15:18:06.093 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-25T15:18:06.093 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-25T15:18:06.093 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-25T15:18:06.093 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-25T15:18:06.093 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T15:18:06.093 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T15:18:06.093 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:18:06.093 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T15:18:06.094 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T15:18:06.095 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T15:18:06.096 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T15:18:06.097 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T15:18:06.098 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T15:18:06.099 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T15:18:06.100 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T15:18:06.101 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T15:18:06.102 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T15:18:06.103 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T15:18:06.104 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout:Install 148 Packages 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 4 Packages 2024-04-25T15:18:06.105 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:18:06.106 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 214 M 2024-04-25T15:18:06.106 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-25T15:18:06.970 INFO:teuthology.orchestra.run.smithi155.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-04-25T15:18:07.368 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:18:07.368 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T15:18:07.380 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T15:18:07.382 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T15:18:07.382 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T15:18:07.383 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T15:18:07.385 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T15:18:07.387 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T15:18:07.388 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T15:18:07.454 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-04-25T15:18:07.463 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-04-25T15:18:07.463 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-04-25T15:18:07.463 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-04-25T15:18:07.463 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T15:18:07.464 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T15:18:07.465 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T15:18:07.466 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T15:18:07.467 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T15:18:07.468 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T15:18:07.469 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T15:18:07.470 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T15:18:07.471 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T15:18:07.472 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T15:18:07.473 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T15:18:07.474 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-04-25T15:18:07.475 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T15:18:07.476 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:18:07.476 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-04-25T15:18:07.476 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================= 2024-04-25T15:18:07.476 INFO:teuthology.orchestra.run.smithi033.stdout:Install 148 Packages 2024-04-25T15:18:07.476 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 4 Packages 2024-04-25T15:18:07.476 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:18:07.476 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 214 M 2024-04-25T15:18:07.477 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-04-25T15:18:07.887 INFO:teuthology.orchestra.run.smithi155.stdout:(2/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 4.6 MB/s | 5.4 MB 00:01 2024-04-25T15:18:07.937 INFO:teuthology.orchestra.run.smithi155.stdout:(3/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 892 kB/s | 863 kB 00:00 2024-04-25T15:18:07.963 INFO:teuthology.orchestra.run.smithi155.stdout:(4/152): ceph-immutable-object-cache-19.0.0-329 1.9 MB/s | 147 kB 00:00 2024-04-25T15:18:08.188 INFO:teuthology.orchestra.run.smithi155.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 6.7 MB/s | 1.5 MB 00:00 2024-04-25T15:18:08.500 INFO:teuthology.orchestra.run.smithi033.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-25T15:18:08.746 INFO:teuthology.orchestra.run.smithi155.stdout:(6/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 8.7 MB/s | 4.9 MB 00:00 2024-04-25T15:18:08.775 INFO:teuthology.orchestra.run.smithi033.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 3.1 MB/s | 863 kB 00:00 2024-04-25T15:18:08.842 INFO:teuthology.orchestra.run.smithi033.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 2.2 MB/s | 147 kB 00:00 2024-04-25T15:18:09.333 INFO:teuthology.orchestra.run.smithi033.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 4.6 MB/s | 2.3 MB 00:00 2024-04-25T15:18:09.659 INFO:teuthology.orchestra.run.smithi033.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 4.6 MB/s | 1.5 MB 00:00 2024-04-25T15:18:10.426 INFO:teuthology.orchestra.run.smithi033.stdout:(6/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 6.4 MB/s | 4.9 MB 00:00 2024-04-25T15:18:10.726 INFO:teuthology.orchestra.run.smithi033.stdout:(7/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 2.1 MB/s | 5.4 MB 00:02 2024-04-25T15:18:10.752 INFO:teuthology.orchestra.run.smithi155.stdout:(7/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 822 kB/s | 2.3 MB 00:02 2024-04-25T15:18:11.005 INFO:teuthology.orchestra.run.smithi155.stdout:(8/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x86 7.9 MB/s | 18 MB 00:02 2024-04-25T15:18:11.072 INFO:teuthology.orchestra.run.smithi155.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 378 kB/s | 25 kB 00:00 2024-04-25T15:18:12.868 INFO:teuthology.orchestra.run.smithi033.stdout:(8/152): ceph-radosgw-19.0.0-3291.g994e2f20.el9 4.7 MB/s | 10 MB 00:02 2024-04-25T15:18:12.959 INFO:teuthology.orchestra.run.smithi033.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 276 kB/s | 25 kB 00:00 2024-04-25T15:18:13.360 INFO:teuthology.orchestra.run.smithi033.stdout:(10/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 6.0 MB/s | 18 MB 00:02 2024-04-25T15:18:13.451 INFO:teuthology.orchestra.run.smithi033.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 2.4 MB/s | 224 kB 00:00 2024-04-25T15:18:13.535 INFO:teuthology.orchestra.run.smithi033.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 324 kB/s | 27 kB 00:00 2024-04-25T15:18:13.619 INFO:teuthology.orchestra.run.smithi033.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 381 kB/s | 32 kB 00:00 2024-04-25T15:18:13.852 INFO:teuthology.orchestra.run.smithi033.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 3.2 MB/s | 756 kB 00:00 2024-04-25T15:18:13.936 INFO:teuthology.orchestra.run.smithi033.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.9 MB/s | 158 kB 00:00 2024-04-25T15:18:14.028 INFO:teuthology.orchestra.run.smithi033.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.4 MB/s | 127 kB 00:00 2024-04-25T15:18:14.186 INFO:teuthology.orchestra.run.smithi033.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 3.1 MB/s | 497 kB 00:00 2024-04-25T15:18:15.628 INFO:teuthology.orchestra.run.smithi033.stdout:(18/152): ceph-common-19.0.0-3291.g994e2f20.el9 2.6 MB/s | 20 MB 00:07 2024-04-25T15:18:15.703 INFO:teuthology.orchestra.run.smithi033.stdout:(19/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 3.4 MB/s | 5.2 MB 00:01 2024-04-25T15:18:15.737 INFO:teuthology.orchestra.run.smithi033.stdout:(20/152): python3-ceph-argparse-19.0.0-3291.g99 416 kB/s | 45 kB 00:00 2024-04-25T15:18:15.787 INFO:teuthology.orchestra.run.smithi033.stdout:(21/152): python3-ceph-common-19.0.0-3291.g994e 1.6 MB/s | 135 kB 00:00 2024-04-25T15:18:15.854 INFO:teuthology.orchestra.run.smithi033.stdout:(22/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.3 MB/s | 161 kB 00:00 2024-04-25T15:18:15.971 INFO:teuthology.orchestra.run.smithi033.stdout:(23/152): python3-rados-19.0.0-3291.g994e2f20.e 1.7 MB/s | 321 kB 00:00 2024-04-25T15:18:16.072 INFO:teuthology.orchestra.run.smithi033.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 993 kB/s | 100 kB 00:00 2024-04-25T15:18:16.147 INFO:teuthology.orchestra.run.smithi033.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.1 MB/s | 86 kB 00:00 2024-04-25T15:18:16.172 INFO:teuthology.orchestra.run.smithi033.stdout:(26/152): python3-rbd-19.0.0-3291.g994e2f20.el9 937 kB/s | 298 kB 00:00 2024-04-25T15:18:16.356 INFO:teuthology.orchestra.run.smithi033.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 924 kB/s | 169 kB 00:00 2024-04-25T15:18:16.440 INFO:teuthology.orchestra.run.smithi033.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 410 kB/s | 34 kB 00:00 2024-04-25T15:18:16.598 INFO:teuthology.orchestra.run.smithi033.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 899 kB/s | 142 kB 00:00 2024-04-25T15:18:17.057 INFO:teuthology.orchestra.run.smithi033.stdout:(30/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 3.3 MB/s | 3.0 MB 00:00 2024-04-25T15:18:18.799 INFO:teuthology.orchestra.run.smithi033.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 1.6 MB/s | 3.5 MB 00:02 2024-04-25T15:18:18.999 INFO:teuthology.orchestra.run.smithi033.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 1.2 MB/s | 249 kB 00:00 2024-04-25T15:18:19.107 INFO:teuthology.orchestra.run.smithi033.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 456 kB/s | 49 kB 00:00 2024-04-25T15:18:19.224 INFO:teuthology.orchestra.run.smithi033.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 141 kB/s | 16 kB 00:00 2024-04-25T15:18:19.325 INFO:teuthology.orchestra.run.smithi033.stdout:(35/152): ceph-mgr-diskprediction-local-19.0.0- 3.3 MB/s | 7.4 MB 00:02 2024-04-25T15:18:19.417 INFO:teuthology.orchestra.run.smithi033.stdout:(36/152): ceph-volume-19.0.0-3291.g994e2f20.el9 1.4 MB/s | 273 kB 00:00 2024-04-25T15:18:19.525 INFO:teuthology.orchestra.run.smithi033.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 168 kB/s | 18 kB 00:00 2024-04-25T15:18:19.625 INFO:teuthology.orchestra.run.smithi033.stdout:(38/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 2.5 MB/s | 762 kB 00:00 2024-04-25T15:18:19.642 INFO:teuthology.orchestra.run.smithi033.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 689 kB/s | 80 kB 00:00 2024-04-25T15:18:19.703 INFO:teuthology.orchestra.run.smithi033.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-25T15:18:19.728 INFO:teuthology.orchestra.run.smithi033.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 195 kB 00:00 2024-04-25T15:18:19.762 INFO:teuthology.orchestra.run.smithi033.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-04-25T15:18:19.820 INFO:teuthology.orchestra.run.smithi033.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-04-25T15:18:19.854 INFO:teuthology.orchestra.run.smithi033.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-04-25T15:18:19.879 INFO:teuthology.orchestra.run.smithi033.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-25T15:18:19.896 INFO:teuthology.orchestra.run.smithi033.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-04-25T15:18:19.921 INFO:teuthology.orchestra.run.smithi033.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 5.1 MB/s | 215 kB 00:00 2024-04-25T15:18:19.955 INFO:teuthology.orchestra.run.smithi033.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-04-25T15:18:19.997 INFO:teuthology.orchestra.run.smithi033.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-04-25T15:18:20.022 INFO:teuthology.orchestra.run.smithi033.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-25T15:18:20.039 INFO:teuthology.orchestra.run.smithi033.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 517 kB/s | 21 kB 00:00 2024-04-25T15:18:20.064 INFO:teuthology.orchestra.run.smithi033.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-25T15:18:20.081 INFO:teuthology.orchestra.run.smithi033.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 794 kB/s | 33 kB 00:00 2024-04-25T15:18:20.115 INFO:teuthology.orchestra.run.smithi033.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 550 kB/s | 18 kB 00:00 2024-04-25T15:18:20.174 INFO:teuthology.orchestra.run.smithi033.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 193 kB/s | 11 kB 00:00 2024-04-25T15:18:20.232 INFO:teuthology.orchestra.run.smithi033.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-04-25T15:18:20.258 INFO:teuthology.orchestra.run.smithi033.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-25T15:18:20.283 INFO:teuthology.orchestra.run.smithi033.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 912 kB/s | 45 kB 00:00 2024-04-25T15:18:20.358 INFO:teuthology.orchestra.run.smithi033.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-04-25T15:18:20.392 INFO:teuthology.orchestra.run.smithi033.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 5.3 MB/s | 582 kB 00:00 2024-04-25T15:18:20.417 INFO:teuthology.orchestra.run.smithi033.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 444 kB/s | 25 kB 00:00 2024-04-25T15:18:20.442 INFO:teuthology.orchestra.run.smithi033.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-04-25T15:18:20.468 INFO:teuthology.orchestra.run.smithi033.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-25T15:18:20.493 INFO:teuthology.orchestra.run.smithi033.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T15:18:20.518 INFO:teuthology.orchestra.run.smithi033.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 709 kB/s | 35 kB 00:00 2024-04-25T15:18:20.718 INFO:teuthology.orchestra.run.smithi033.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2024-04-25T15:18:20.785 INFO:teuthology.orchestra.run.smithi033.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-04-25T15:18:20.819 INFO:teuthology.orchestra.run.smithi033.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-25T15:18:20.853 INFO:teuthology.orchestra.run.smithi033.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 14 MB/s | 911 kB 00:00 2024-04-25T15:18:20.878 INFO:teuthology.orchestra.run.smithi033.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-04-25T15:18:20.962 INFO:teuthology.orchestra.run.smithi033.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-04-25T15:18:21.037 INFO:teuthology.orchestra.run.smithi033.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-04-25T15:18:21.062 INFO:teuthology.orchestra.run.smithi033.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 898 kB/s | 87 kB 00:00 2024-04-25T15:18:21.104 INFO:teuthology.orchestra.run.smithi033.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 6.0 MB/s | 244 kB 00:00 2024-04-25T15:18:21.154 INFO:teuthology.orchestra.run.smithi033.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 5.2 MB/s | 248 kB 00:00 2024-04-25T15:18:21.230 INFO:teuthology.orchestra.run.smithi033.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-04-25T15:18:21.255 INFO:teuthology.orchestra.run.smithi033.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 260 kB/s | 26 kB 00:00 2024-04-25T15:18:21.297 INFO:teuthology.orchestra.run.smithi033.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 4.1 MB/s | 172 kB 00:00 2024-04-25T15:18:21.322 INFO:teuthology.orchestra.run.smithi033.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 208 kB/s | 19 kB 00:00 2024-04-25T15:18:21.347 INFO:teuthology.orchestra.run.smithi033.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-04-25T15:18:21.389 INFO:teuthology.orchestra.run.smithi033.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.0 MB/s | 250 kB 00:00 2024-04-25T15:18:21.431 INFO:teuthology.orchestra.run.smithi033.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 5.7 MB/s | 222 kB 00:00 2024-04-25T15:18:21.498 INFO:teuthology.orchestra.run.smithi033.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-04-25T15:18:21.524 INFO:teuthology.orchestra.run.smithi033.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 860 kB/s | 77 kB 00:00 2024-04-25T15:18:21.540 INFO:teuthology.orchestra.run.smithi033.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-04-25T15:18:21.566 INFO:teuthology.orchestra.run.smithi033.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-04-25T15:18:21.591 INFO:teuthology.orchestra.run.smithi033.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T15:18:21.616 INFO:teuthology.orchestra.run.smithi033.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T15:18:21.633 INFO:teuthology.orchestra.run.smithi033.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-04-25T15:18:21.650 INFO:teuthology.orchestra.run.smithi033.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-04-25T15:18:21.675 INFO:teuthology.orchestra.run.smithi033.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 1.7 MB/s | 42 kB 00:00 2024-04-25T15:18:21.709 INFO:teuthology.orchestra.run.smithi033.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.4 MB/s | 44 kB 00:00 2024-04-25T15:18:21.751 INFO:teuthology.orchestra.run.smithi033.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 5.6 MB/s | 221 kB 00:00 2024-04-25T15:18:21.785 INFO:teuthology.orchestra.run.smithi033.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 1.2 MB/s | 36 kB 00:00 2024-04-25T15:18:21.835 INFO:teuthology.orchestra.run.smithi033.stdout:(95/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.0 MB/s | 47 kB 00:00 2024-04-25T15:18:21.885 INFO:teuthology.orchestra.run.smithi033.stdout:(96/152): socat-1.7.4.1-5.el9.x86_64.rpm 6.3 MB/s | 305 kB 00:00 2024-04-25T15:18:22.044 INFO:teuthology.orchestra.run.smithi033.stdout:(97/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-04-25T15:18:22.069 INFO:teuthology.orchestra.run.smithi033.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 319 kB/s | 58 kB 00:00 2024-04-25T15:18:22.094 INFO:teuthology.orchestra.run.smithi033.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T15:18:22.128 INFO:teuthology.orchestra.run.smithi033.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T15:18:22.153 INFO:teuthology.orchestra.run.smithi033.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-04-25T15:18:22.179 INFO:teuthology.orchestra.run.smithi033.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-04-25T15:18:22.212 INFO:teuthology.orchestra.run.smithi033.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-04-25T15:18:22.946 INFO:teuthology.orchestra.run.smithi033.stdout:(104/152): gperftools-libs-2.9.1-2.el9.x86_64.r 421 kB/s | 309 kB 00:00 2024-04-25T15:18:22.971 INFO:teuthology.orchestra.run.smithi033.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 693 kB/s | 548 kB 00:00 2024-04-25T15:18:23.055 INFO:teuthology.orchestra.run.smithi033.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 179 kB/s | 19 kB 00:00 2024-04-25T15:18:23.079 INFO:teuthology.orchestra.run.smithi155.stdout:(10/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 840 kB/s | 10 MB 00:12 2024-04-25T15:18:23.163 INFO:teuthology.orchestra.run.smithi033.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-04-25T15:18:23.254 INFO:teuthology.orchestra.run.smithi155.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 1.3 MB/s | 224 kB 00:00 2024-04-25T15:18:23.280 INFO:teuthology.orchestra.run.smithi033.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 417 kB/s | 49 kB 00:00 2024-04-25T15:18:23.363 INFO:teuthology.orchestra.run.smithi155.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 249 kB/s | 27 kB 00:00 2024-04-25T15:18:23.389 INFO:teuthology.orchestra.run.smithi033.stdout:(109/152): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-25T15:18:23.414 INFO:teuthology.orchestra.run.smithi033.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 504 kB/s | 67 kB 00:00 2024-04-25T15:18:23.463 INFO:teuthology.orchestra.run.smithi155.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 318 kB/s | 32 kB 00:00 2024-04-25T15:18:23.523 INFO:teuthology.orchestra.run.smithi033.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-04-25T15:18:23.640 INFO:teuthology.orchestra.run.smithi033.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-04-25T15:18:23.698 INFO:teuthology.orchestra.run.smithi033.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.9 MB/s | 838 kB 00:00 2024-04-25T15:18:23.749 INFO:teuthology.orchestra.run.smithi033.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 401 kB/s | 43 kB 00:00 2024-04-25T15:18:23.807 INFO:teuthology.orchestra.run.smithi033.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-04-25T15:18:23.857 INFO:teuthology.orchestra.run.smithi033.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-04-25T15:18:23.924 INFO:teuthology.orchestra.run.smithi033.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-25T15:18:23.966 INFO:teuthology.orchestra.run.smithi033.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-25T15:18:23.997 INFO:teuthology.orchestra.run.smithi155.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 1.4 MB/s | 756 kB 00:00 2024-04-25T15:18:24.051 INFO:teuthology.orchestra.run.smithi033.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-04-25T15:18:24.075 INFO:teuthology.orchestra.run.smithi033.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 325 kB/s | 35 kB 00:00 2024-04-25T15:18:24.192 INFO:teuthology.orchestra.run.smithi033.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.4 MB/s | 206 kB 00:00 2024-04-25T15:18:24.230 INFO:teuthology.orchestra.run.smithi155.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 677 kB/s | 158 kB 00:00 2024-04-25T15:18:24.250 INFO:teuthology.orchestra.run.smithi033.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-04-25T15:18:24.301 INFO:teuthology.orchestra.run.smithi033.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-25T15:18:24.351 INFO:teuthology.orchestra.run.smithi033.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-04-25T15:18:24.410 INFO:teuthology.orchestra.run.smithi033.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2024-04-25T15:18:24.431 INFO:teuthology.orchestra.run.smithi155.stdout:(16/152): ceph-common-19.0.0-3291.g994e2f20.el9 1.1 MB/s | 20 MB 00:17 2024-04-25T15:18:24.455 INFO:teuthology.orchestra.run.smithi155.stdout:(17/152): librados-devel-19.0.0-3291.g994e2f20. 564 kB/s | 127 kB 00:00 2024-04-25T15:18:24.468 INFO:teuthology.orchestra.run.smithi033.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-04-25T15:18:24.518 INFO:teuthology.orchestra.run.smithi033.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-04-25T15:18:24.577 INFO:teuthology.orchestra.run.smithi033.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-04-25T15:18:24.686 INFO:teuthology.orchestra.run.smithi033.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 428 kB/s | 46 kB 00:00 2024-04-25T15:18:24.719 INFO:teuthology.orchestra.run.smithi033.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-04-25T15:18:24.795 INFO:teuthology.orchestra.run.smithi033.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 726 kB/s | 79 kB 00:00 2024-04-25T15:18:24.806 INFO:teuthology.orchestra.run.smithi155.stdout:(18/152): libradosstriper1-19.0.0-3291.g994e2f2 1.3 MB/s | 497 kB 00:00 2024-04-25T15:18:24.820 INFO:teuthology.orchestra.run.smithi033.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-04-25T15:18:24.904 INFO:teuthology.orchestra.run.smithi033.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-04-25T15:18:24.914 INFO:teuthology.orchestra.run.smithi155.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 416 kB/s | 45 kB 00:00 2024-04-25T15:18:24.920 INFO:teuthology.orchestra.run.smithi033.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-04-25T15:18:25.013 INFO:teuthology.orchestra.run.smithi033.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 829 kB/s | 90 kB 00:00 2024-04-25T15:18:25.029 INFO:teuthology.orchestra.run.smithi033.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 260 kB/s | 28 kB 00:00 2024-04-25T15:18:25.113 INFO:teuthology.orchestra.run.smithi033.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-04-25T15:18:25.114 INFO:teuthology.orchestra.run.smithi155.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 676 kB/s | 135 kB 00:00 2024-04-25T15:18:25.138 INFO:teuthology.orchestra.run.smithi033.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-25T15:18:25.213 INFO:teuthology.orchestra.run.smithi033.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 591 kB/s | 59 kB 00:00 2024-04-25T15:18:25.238 INFO:teuthology.orchestra.run.smithi033.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2024-04-25T15:18:25.314 INFO:teuthology.orchestra.run.smithi033.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 508 kB/s | 51 kB 00:00 2024-04-25T15:18:25.323 INFO:teuthology.orchestra.run.smithi155.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 775 kB/s | 161 kB 00:00 2024-04-25T15:18:25.348 INFO:teuthology.orchestra.run.smithi033.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-25T15:18:25.415 INFO:teuthology.orchestra.run.smithi033.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 895 kB/s | 90 kB 00:00 2024-04-25T15:18:25.473 INFO:teuthology.orchestra.run.smithi033.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-25T15:18:25.523 INFO:teuthology.orchestra.run.smithi033.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-04-25T15:18:25.582 INFO:teuthology.orchestra.run.smithi033.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-25T15:18:25.624 INFO:teuthology.orchestra.run.smithi155.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 1.0 MB/s | 321 kB 00:00 2024-04-25T15:18:25.674 INFO:teuthology.orchestra.run.smithi033.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-25T15:18:25.915 INFO:teuthology.orchestra.run.smithi155.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 1.0 MB/s | 298 kB 00:00 2024-04-25T15:18:26.041 INFO:teuthology.orchestra.run.smithi155.stdout:(24/152): python3-rgw-19.0.0-3291.g994e2f20.el9 796 kB/s | 100 kB 00:00 2024-04-25T15:18:26.266 INFO:teuthology.orchestra.run.smithi155.stdout:(25/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 383 kB/s | 86 kB 00:00 2024-04-25T15:18:26.742 INFO:teuthology.orchestra.run.smithi155.stdout:(26/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 2.3 MB/s | 5.2 MB 00:02 2024-04-25T15:18:26.867 INFO:teuthology.orchestra.run.smithi155.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.3 MB/s | 169 kB 00:00 2024-04-25T15:18:26.907 INFO:teuthology.orchestra.run.smithi033.stdout:(148/152): librados2-19.0.0-3291.g994e2f20.el9. 2.5 MB/s | 3.3 MB 00:01 2024-04-25T15:18:26.999 INFO:teuthology.orchestra.run.smithi033.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 15 MB/s | 1.3 MB 00:00 2024-04-25T15:18:27.000 INFO:teuthology.orchestra.run.smithi155.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 257 kB/s | 34 kB 00:00 2024-04-25T15:18:27.101 INFO:teuthology.orchestra.run.smithi155.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.4 MB/s | 142 kB 00:00 2024-04-25T15:18:27.116 INFO:teuthology.orchestra.run.smithi033.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-25T15:18:27.810 INFO:teuthology.orchestra.run.smithi155.stdout:(30/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 2.0 MB/s | 3.0 MB 00:01 2024-04-25T15:18:28.249 INFO:teuthology.orchestra.run.smithi033.stdout:(151/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 1.2 MB/s | 3.1 MB 00:02 2024-04-25T15:18:28.251 INFO:teuthology.orchestra.run.smithi155.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 3.1 MB/s | 3.5 MB 00:01 2024-04-25T15:18:28.360 INFO:teuthology.orchestra.run.smithi155.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 2.3 MB/s | 249 kB 00:00 2024-04-25T15:18:28.469 INFO:teuthology.orchestra.run.smithi155.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 456 kB/s | 49 kB 00:00 2024-04-25T15:18:28.577 INFO:teuthology.orchestra.run.smithi155.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 152 kB/s | 16 kB 00:00 2024-04-25T15:18:28.744 INFO:teuthology.orchestra.run.smithi155.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 1.6 MB/s | 273 kB 00:00 2024-04-25T15:18:29.044 INFO:teuthology.orchestra.run.smithi155.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 2.5 MB/s | 762 kB 00:00 2024-04-25T15:18:29.145 INFO:teuthology.orchestra.run.smithi155.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 182 kB/s | 18 kB 00:00 2024-04-25T15:18:29.270 INFO:teuthology.orchestra.run.smithi155.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 643 kB/s | 80 kB 00:00 2024-04-25T15:18:29.353 INFO:teuthology.orchestra.run.smithi155.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2024-04-25T15:18:29.403 INFO:teuthology.orchestra.run.smithi155.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-25T15:18:29.446 INFO:teuthology.orchestra.run.smithi155.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-04-25T15:18:29.504 INFO:teuthology.orchestra.run.smithi155.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-04-25T15:18:29.529 INFO:teuthology.orchestra.run.smithi155.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 4.2 MB/s | 106 kB 00:00 2024-04-25T15:18:29.563 INFO:teuthology.orchestra.run.smithi155.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-04-25T15:18:29.597 INFO:teuthology.orchestra.run.smithi155.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 3.7 MB/s | 125 kB 00:00 2024-04-25T15:18:29.630 INFO:teuthology.orchestra.run.smithi155.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 6.3 MB/s | 215 kB 00:00 2024-04-25T15:18:29.672 INFO:teuthology.orchestra.run.smithi155.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 16 MB/s | 689 kB 00:00 2024-04-25T15:18:29.731 INFO:teuthology.orchestra.run.smithi155.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-25T15:18:29.764 INFO:teuthology.orchestra.run.smithi155.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-04-25T15:18:29.798 INFO:teuthology.orchestra.run.smithi155.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 644 kB/s | 21 kB 00:00 2024-04-25T15:18:29.840 INFO:teuthology.orchestra.run.smithi155.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-04-25T15:18:29.874 INFO:teuthology.orchestra.run.smithi155.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 987 kB/s | 33 kB 00:00 2024-04-25T15:18:29.991 INFO:teuthology.orchestra.run.smithi155.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-25T15:18:30.033 INFO:teuthology.orchestra.run.smithi155.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-04-25T15:18:30.066 INFO:teuthology.orchestra.run.smithi155.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-04-25T15:18:30.150 INFO:teuthology.orchestra.run.smithi155.stdout:(56/152): ceph-mgr-diskprediction-local-19.0.0- 3.2 MB/s | 7.4 MB 00:02 2024-04-25T15:18:30.175 INFO:teuthology.orchestra.run.smithi155.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-25T15:18:30.192 INFO:teuthology.orchestra.run.smithi155.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-25T15:18:30.226 INFO:teuthology.orchestra.run.smithi155.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-25T15:18:30.259 INFO:teuthology.orchestra.run.smithi155.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 8.7 MB/s | 582 kB 00:00 2024-04-25T15:18:30.276 INFO:teuthology.orchestra.run.smithi155.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 520 kB/s | 25 kB 00:00 2024-04-25T15:18:30.293 INFO:teuthology.orchestra.run.smithi155.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-25T15:18:30.318 INFO:teuthology.orchestra.run.smithi155.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-04-25T15:18:30.344 INFO:teuthology.orchestra.run.smithi155.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T15:18:30.361 INFO:teuthology.orchestra.run.smithi155.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 855 kB/s | 35 kB 00:00 2024-04-25T15:18:30.469 INFO:teuthology.orchestra.run.smithi155.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-04-25T15:18:30.861 INFO:teuthology.orchestra.run.smithi155.stdout:(67/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 2.2 MB/s | 43 MB 00:19 2024-04-25T15:18:30.920 INFO:teuthology.orchestra.run.smithi155.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-04-25T15:18:30.953 INFO:teuthology.orchestra.run.smithi155.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-04-25T15:18:30.978 INFO:teuthology.orchestra.run.smithi155.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 7.9 MB/s | 911 kB 00:00 2024-04-25T15:18:31.003 INFO:teuthology.orchestra.run.smithi155.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-04-25T15:18:31.079 INFO:teuthology.orchestra.run.smithi155.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-25T15:18:31.146 INFO:teuthology.orchestra.run.smithi155.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-04-25T15:18:31.171 INFO:teuthology.orchestra.run.smithi155.stdout:(74/152): python3-attrs-20.3.0-7.el9.noarch.rpm 535 kB/s | 87 kB 00:00 2024-04-25T15:18:31.380 INFO:teuthology.orchestra.run.smithi155.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-25T15:18:31.405 INFO:teuthology.orchestra.run.smithi155.stdout:(76/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.0 MB/s | 244 kB 00:00 2024-04-25T15:18:31.430 INFO:teuthology.orchestra.run.smithi155.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 968 kB/s | 248 kB 00:00 2024-04-25T15:18:31.455 INFO:teuthology.orchestra.run.smithi155.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 346 kB/s | 26 kB 00:00 2024-04-25T15:18:31.481 INFO:teuthology.orchestra.run.smithi155.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-04-25T15:18:31.505 INFO:teuthology.orchestra.run.smithi155.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-25T15:18:31.531 INFO:teuthology.orchestra.run.smithi155.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 464 kB/s | 35 kB 00:00 2024-04-25T15:18:31.589 INFO:teuthology.orchestra.run.smithi155.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-25T15:18:31.657 INFO:teuthology.orchestra.run.smithi155.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-04-25T15:18:31.681 INFO:teuthology.orchestra.run.smithi155.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-04-25T15:18:31.707 INFO:teuthology.orchestra.run.smithi155.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 674 kB/s | 77 kB 00:00 2024-04-25T15:18:31.734 INFO:teuthology.orchestra.run.smithi155.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 814 kB/s | 42 kB 00:00 2024-04-25T15:18:31.759 INFO:teuthology.orchestra.run.smithi155.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 3.4 MB/s | 269 kB 00:00 2024-04-25T15:18:31.785 INFO:teuthology.orchestra.run.smithi155.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-04-25T15:18:31.810 INFO:teuthology.orchestra.run.smithi155.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-04-25T15:18:31.826 INFO:teuthology.orchestra.run.smithi155.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 767 kB/s | 51 kB 00:00 2024-04-25T15:18:31.843 INFO:teuthology.orchestra.run.smithi155.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 928 kB/s | 54 kB 00:00 2024-04-25T15:18:31.893 INFO:teuthology.orchestra.run.smithi155.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 628 kB/s | 42 kB 00:00 2024-04-25T15:18:31.994 INFO:teuthology.orchestra.run.smithi155.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 295 kB/s | 44 kB 00:00 2024-04-25T15:18:32.219 INFO:teuthology.orchestra.run.smithi155.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-04-25T15:18:32.244 INFO:teuthology.orchestra.run.smithi155.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 634 kB/s | 221 kB 00:00 2024-04-25T15:18:32.261 INFO:teuthology.orchestra.run.smithi155.stdout:(96/152): qatlib-service-24.02.0-1.el9.x86_64.r 136 kB/s | 36 kB 00:00 2024-04-25T15:18:32.278 INFO:teuthology.orchestra.run.smithi155.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 819 kB/s | 47 kB 00:00 2024-04-25T15:18:32.303 INFO:teuthology.orchestra.run.smithi155.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 305 kB 00:00 2024-04-25T15:18:32.320 INFO:teuthology.orchestra.run.smithi155.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-04-25T15:18:32.337 INFO:teuthology.orchestra.run.smithi155.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-04-25T15:18:32.354 INFO:teuthology.orchestra.run.smithi155.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T15:18:32.379 INFO:teuthology.orchestra.run.smithi155.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-25T15:18:32.396 INFO:teuthology.orchestra.run.smithi155.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 383 kB/s | 22 kB 00:00 2024-04-25T15:18:32.430 INFO:teuthology.orchestra.run.smithi155.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-04-25T15:18:32.705 INFO:teuthology.orchestra.run.smithi155.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 71 kB/s | 19 kB 00:00 2024-04-25T15:18:32.807 INFO:teuthology.orchestra.run.smithi033.stdout:(152/152): ceph-test-19.0.0-3291.g994e2f20.el9. 2.2 MB/s | 43 MB 00:19 2024-04-25T15:18:32.814 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:18:32.814 INFO:teuthology.orchestra.run.smithi033.stdout:Total 8.5 MB/s | 214 MB 00:25 2024-04-25T15:18:33.213 INFO:teuthology.orchestra.run.smithi155.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 378 kB/s | 309 kB 00:00 2024-04-25T15:18:33.339 INFO:teuthology.orchestra.run.smithi155.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-04-25T15:18:33.472 INFO:teuthology.orchestra.run.smithi155.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2024-04-25T15:18:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:(109/152): abseil-cpp-20211102.0-3.el9.x86_64.r 476 kB/s | 548 kB 00:01 2024-04-25T15:18:33.673 INFO:teuthology.orchestra.run.smithi155.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 336 kB/s | 67 kB 00:00 2024-04-25T15:18:33.706 INFO:teuthology.orchestra.run.smithi155.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 862 kB/s | 151 kB 00:00 2024-04-25T15:18:33.956 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-04-25T15:18:34.116 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-04-25T15:18:34.116 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-04-25T15:18:34.157 INFO:teuthology.orchestra.run.smithi155.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 1.2 MB/s | 548 kB 00:00 2024-04-25T15:18:34.257 INFO:teuthology.orchestra.run.smithi155.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 435 kB/s | 43 kB 00:00 2024-04-25T15:18:34.357 INFO:teuthology.orchestra.run.smithi155.stdout:(114/152): python3-cachetools-4.2.4-1.el9.noarc 322 kB/s | 32 kB 00:00 2024-04-25T15:18:34.457 INFO:teuthology.orchestra.run.smithi155.stdout:(115/152): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2024-04-25T15:18:34.516 INFO:teuthology.orchestra.run.smithi155.stdout:(116/152): libarrow-9.0.0-10.el9.x86_64.rpm 2.4 MB/s | 4.4 MB 00:01 2024-04-25T15:18:34.566 INFO:teuthology.orchestra.run.smithi155.stdout:(117/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 939 kB/s | 838 kB 00:00 2024-04-25T15:18:34.616 INFO:teuthology.orchestra.run.smithi155.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-25T15:18:34.642 INFO:teuthology.orchestra.run.smithi155.stdout:(119/152): python3-cheroot-8.6.0-4.el9.noarch.r 934 kB/s | 172 kB 00:00 2024-04-25T15:18:34.701 INFO:teuthology.orchestra.run.smithi155.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 422 kB/s | 35 kB 00:00 2024-04-25T15:18:34.809 INFO:teuthology.orchestra.run.smithi155.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.2 MB/s | 206 kB 00:00 2024-04-25T15:18:34.842 INFO:teuthology.orchestra.run.smithi155.stdout:(122/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-04-25T15:18:34.951 INFO:teuthology.orchestra.run.smithi155.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-04-25T15:18:35.010 INFO:teuthology.orchestra.run.smithi155.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 721 kB/s | 144 kB 00:00 2024-04-25T15:18:35.085 INFO:teuthology.orchestra.run.smithi155.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 132 kB/s | 18 kB 00:00 2024-04-25T15:18:35.144 INFO:teuthology.orchestra.run.smithi155.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 173 kB/s | 23 kB 00:00 2024-04-25T15:18:35.202 INFO:teuthology.orchestra.run.smithi155.stdout:(127/152): python3-grpcio-1.46.7-10.el9.x86_64. 4.1 MB/s | 2.0 MB 00:00 2024-04-25T15:18:35.227 INFO:teuthology.orchestra.run.smithi155.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2024-04-25T15:18:35.253 INFO:teuthology.orchestra.run.smithi155.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-04-25T15:18:35.322 INFO:teuthology.orchestra.run.smithi155.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-04-25T15:18:35.345 INFO:teuthology.orchestra.run.smithi155.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 859 kB/s | 79 kB 00:00 2024-04-25T15:18:35.420 INFO:teuthology.orchestra.run.smithi155.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 576 kB/s | 58 kB 00:00 2024-04-25T15:18:35.454 INFO:teuthology.orchestra.run.smithi155.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-04-25T15:18:35.512 INFO:teuthology.orchestra.run.smithi155.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-04-25T15:18:35.537 INFO:teuthology.orchestra.run.smithi155.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-04-25T15:18:35.563 INFO:teuthology.orchestra.run.smithi155.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 827 kB/s | 90 kB 00:00 2024-04-25T15:18:35.605 INFO:teuthology.orchestra.run.smithi155.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-04-25T15:18:35.630 INFO:teuthology.orchestra.run.smithi155.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-25T15:18:35.664 INFO:teuthology.orchestra.run.smithi155.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-25T15:18:35.697 INFO:teuthology.orchestra.run.smithi155.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-04-25T15:18:35.722 INFO:teuthology.orchestra.run.smithi155.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-04-25T15:18:35.756 INFO:teuthology.orchestra.run.smithi155.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-04-25T15:18:35.823 INFO:teuthology.orchestra.run.smithi155.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 892 kB/s | 90 kB 00:00 2024-04-25T15:18:35.857 INFO:teuthology.orchestra.run.smithi155.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-04-25T15:18:35.882 INFO:teuthology.orchestra.run.smithi155.stdout:(145/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-04-25T15:18:35.916 INFO:teuthology.orchestra.run.smithi155.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-25T15:18:35.957 INFO:teuthology.orchestra.run.smithi155.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-25T15:18:35.960 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-04-25T15:18:35.961 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-04-25T15:18:36.582 INFO:teuthology.orchestra.run.smithi155.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-04-25T15:18:36.666 INFO:teuthology.orchestra.run.smithi155.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 16 MB/s | 1.3 MB 00:00 2024-04-25T15:18:36.783 INFO:teuthology.orchestra.run.smithi155.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-25T15:18:37.725 INFO:teuthology.orchestra.run.smithi155.stdout:(151/152): librados2-19.0.0-3291.g994e2f20.el9. 1.8 MB/s | 3.3 MB 00:01 2024-04-25T15:18:37.917 INFO:teuthology.orchestra.run.smithi155.stdout:(152/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 1.6 MB/s | 3.1 MB 00:01 2024-04-25T15:18:37.920 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-25T15:18:37.921 INFO:teuthology.orchestra.run.smithi155.stdout:Total 6.7 MB/s | 214 MB 00:31 2024-04-25T15:18:39.028 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-25T15:18:39.173 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-25T15:18:39.173 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-25T15:18:40.898 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-25T15:18:40.898 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-25T15:18:41.927 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-04-25T15:18:42.011 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T15:18:42.050 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T15:18:42.104 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T15:18:42.146 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T15:18:42.171 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T15:18:42.214 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T15:18:42.567 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T15:18:42.696 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:18:42.825 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:18:42.856 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:18:42.948 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:18:42.976 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:18:43.133 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T15:18:43.191 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T15:18:43.218 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:18:43.325 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:18:43.352 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:18:43.415 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:18:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:18:43.458 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:18:43.654 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:18:43.686 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:18:43.798 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T15:18:43.901 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T15:18:43.935 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T15:18:43.970 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T15:18:44.046 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T15:18:44.095 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T15:18:44.139 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T15:18:44.170 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T15:18:44.198 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T15:18:44.271 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T15:18:44.330 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T15:18:44.359 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T15:18:44.403 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T15:18:44.482 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T15:18:44.514 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T15:18:44.558 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T15:18:44.586 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T15:18:44.660 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T15:18:44.718 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T15:18:44.795 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T15:18:44.940 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T15:18:44.996 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T15:18:45.554 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T15:18:45.643 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T15:18:45.678 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T15:18:45.720 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T15:18:45.759 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T15:18:45.801 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T15:18:45.972 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T15:18:46.028 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T15:18:46.084 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T15:18:46.158 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T15:18:46.195 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T15:18:46.231 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T15:18:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T15:18:46.315 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T15:18:46.358 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T15:18:46.400 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T15:18:46.559 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T15:18:46.613 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T15:18:46.643 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T15:18:46.685 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T15:18:46.784 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T15:18:46.826 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T15:18:46.849 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-25T15:18:46.866 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T15:18:46.900 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T15:18:46.925 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T15:18:46.937 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T15:18:46.975 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T15:18:47.002 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T15:18:47.029 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T15:18:47.062 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T15:18:47.088 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T15:18:47.130 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T15:18:47.141 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T15:18:47.174 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T15:18:47.201 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T15:18:47.236 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T15:18:47.275 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T15:18:47.315 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T15:18:47.345 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T15:18:47.371 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T15:18:47.404 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T15:18:47.446 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T15:18:47.458 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T15:18:47.480 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T15:18:47.569 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T15:18:47.589 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:18:47.619 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T15:18:47.650 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T15:18:47.706 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T15:18:47.712 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:18:47.740 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:18:47.817 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T15:18:47.830 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:18:47.868 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T15:18:47.869 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:18:48.019 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T15:18:48.066 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T15:18:48.094 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:18:48.190 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:18:48.219 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:18:48.282 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T15:18:48.304 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:18:48.329 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T15:18:48.545 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:18:48.578 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T15:18:48.637 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T15:18:48.688 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T15:18:48.690 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T15:18:48.724 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T15:18:48.782 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T15:18:48.811 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T15:18:48.828 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T15:18:48.862 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T15:18:48.883 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T15:18:48.936 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T15:18:48.969 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T15:18:48.972 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T15:18:49.009 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T15:18:49.021 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T15:18:49.053 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T15:18:49.081 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T15:18:49.150 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T15:18:49.196 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T15:18:49.204 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T15:18:49.223 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T15:18:49.234 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T15:18:49.278 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T15:18:49.304 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T15:18:49.362 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T15:18:49.396 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T15:18:49.440 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T15:18:49.468 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T15:18:49.539 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T15:18:49.583 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T15:18:49.657 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T15:18:49.790 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T15:18:49.843 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T15:18:50.000 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T15:18:50.118 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T15:18:50.375 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T15:18:50.472 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T15:18:50.501 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T15:18:50.544 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T15:18:50.582 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T15:18:50.623 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T15:18:50.801 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T15:18:50.860 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T15:18:50.915 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T15:18:51.004 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T15:18:51.035 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T15:18:51.072 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T15:18:51.118 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T15:18:51.154 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T15:18:51.197 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T15:18:51.239 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T15:18:51.376 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T15:18:51.419 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T15:18:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T15:18:51.450 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T15:18:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T15:18:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T15:18:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T15:18:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T15:18:51.585 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T15:18:51.616 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T15:18:51.656 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T15:18:51.681 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T15:18:51.714 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T15:18:51.790 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T15:18:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T15:18:51.925 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T15:18:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:18:51.955 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T15:18:51.983 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T15:18:52.017 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T15:18:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:18:52.056 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T15:18:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T15:18:52.087 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T15:18:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T15:18:52.117 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T15:18:52.143 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T15:18:52.177 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T15:18:52.218 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T15:18:52.252 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T15:18:52.340 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T15:18:52.391 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T15:18:52.430 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T15:18:52.478 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T15:18:52.577 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T15:18:52.624 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T15:18:52.635 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T15:18:52.669 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:18:52.741 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:18:52.771 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T15:18:53.359 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T15:18:53.404 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T15:18:53.437 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T15:18:53.538 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T15:18:53.595 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T15:18:53.682 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T15:18:53.723 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T15:18:53.950 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T15:18:54.053 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T15:18:54.132 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T15:18:54.789 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T15:18:54.927 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T15:18:55.110 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:18:55.150 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:18:55.742 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:18:55.787 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:18:55.879 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:18:55.879 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T15:18:55.879 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T15:18:55.879 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:18:55.913 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:18:56.180 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T15:18:56.265 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T15:18:56.292 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T15:18:56.326 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T15:18:56.649 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T15:18:56.696 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:18:56.787 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T15:18:56.818 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T15:18:56.854 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T15:18:57.345 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T15:18:57.374 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:18:57.428 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T15:18:57.459 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T15:18:59.685 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:18:59.722 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:19:00.279 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T15:19:00.342 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:19:00.435 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T15:19:00.435 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T15:19:00.436 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T15:19:00.436 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:00.459 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:19:07.740 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:19:07.740 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-04-25T15:19:07.741 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-04-25T15:19:07.741 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-04-25T15:19:07.741 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-04-25T15:19:07.741 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-04-25T15:19:07.741 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /root 2024-04-25T15:19:07.741 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-04-25T15:19:07.741 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:07.924 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:19:07.944 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:19:07.944 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:07.944 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T15:19:07.944 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:09.585 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:19:09.613 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:19:09.613 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:09.613 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T15:19:09.613 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:19:09.613 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:19:09.613 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:09.853 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:19:09.877 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:19:09.877 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:09.877 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T15:19:09.877 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:19:09.877 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:19:09.877 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:10.362 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:19:10.386 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:19:10.387 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:10.387 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T15:19:10.387 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:19:10.387 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:19:10.387 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:10.493 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T15:19:10.542 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T15:19:10.606 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T15:19:10.802 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T15:19:10.847 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T15:19:10.927 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T15:19:11.024 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:19:11.167 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:19:11.213 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T15:19:11.245 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T15:19:11.272 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T15:19:11.743 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:19:11.771 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:19:11.812 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T15:19:11.835 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T15:19:11.835 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-04-25T15:19:11.835 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-04-25T15:19:11.835 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-04-25T15:19:11.835 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-04-25T15:19:11.835 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-04-25T15:19:11.836 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2024-04-25T15:19:11.836 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-04-25T15:19:11.836 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:11.876 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T15:19:11.910 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:19:12.019 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:19:12.035 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T15:19:12.035 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:12.035 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T15:19:12.035 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:13.013 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:19:13.045 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:19:13.605 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:19:13.631 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T15:19:13.631 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:13.631 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T15:19:13.631 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:19:13.632 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T15:19:13.632 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:13.856 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:19:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T15:19:13.879 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:13.879 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T15:19:13.879 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:19:13.879 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T15:19:13.879 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:14.069 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:19:14.087 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:19:14.197 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:19:14.340 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:19:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T15:19:14.363 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:14.363 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T15:19:14.363 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:19:14.363 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T15:19:14.363 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:14.370 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T15:19:14.406 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:19:14.430 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:19:14.431 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:14.431 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T15:19:14.431 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:19:14.431 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:19:14.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T15:19:14.482 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:19:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:19:14.519 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T15:19:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T15:19:14.596 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T15:19:14.648 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T15:19:14.759 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T15:19:14.807 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T15:19:14.886 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T15:19:14.973 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:19:15.114 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:19:15.157 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T15:19:15.189 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T15:19:15.217 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T15:19:15.641 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T15:19:15.667 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:19:15.676 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:19:15.692 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:19:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T15:19:15.692 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:19:15.693 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:19:15.693 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:15.707 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T15:19:15.735 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:19:15.739 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T15:19:15.758 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:19:15.759 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:15.759 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T15:19:15.759 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:15.800 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T15:19:15.810 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:19:15.834 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:19:15.835 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:15.835 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T15:19:15.835 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:19:15.835 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:19:15.835 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:15.838 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:19:16.169 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:19:16.194 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:19:16.194 INFO:teuthology.orchestra.run.smithi033.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:16.194 INFO:teuthology.orchestra.run.smithi033.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T15:19:16.194 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:19:16.194 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:19:16.194 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:16.886 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T15:19:16.923 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:19:17.897 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T15:19:17.932 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:19:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T15:19:18.198 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T15:19:18.242 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:19:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T15:19:18.265 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:18.265 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T15:19:18.265 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:19:18.265 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T15:19:18.265 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:19:18.321 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T15:19:18.420 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T15:19:18.475 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T15:19:19.411 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T15:19:19.437 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:19:19.459 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T15:19:19.460 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:19.460 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T15:19:19.460 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:19:19.460 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T15:19:19.460 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:19.513 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:19:19.534 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T15:19:19.534 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:19.534 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T15:19:19.535 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:19.580 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:19:19.602 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T15:19:19.602 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:19.602 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T15:19:19.602 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:19:19.602 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T15:19:19.602 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:19.914 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:19:19.936 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T15:19:19.936 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T15:19:19.936 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T15:19:19.936 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:19:19.936 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T15:19:19.937 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:20.723 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T15:19:20.765 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T15:19:20.806 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T15:19:20.837 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T15:19:20.865 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T15:19:21.060 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T15:19:21.102 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T15:19:21.132 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T15:19:21.760 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:19:21.804 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:19:21.825 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:19:22.720 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T15:19:22.809 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T15:19:22.850 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T15:19:22.935 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T15:19:22.980 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T15:19:22.980 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:19:23.072 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:19:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:19:23.105 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:19:23.195 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:19:23.266 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:19:24.201 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T15:19:24.242 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T15:19:24.283 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T15:19:24.315 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T15:19:24.342 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T15:19:24.523 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T15:19:24.563 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T15:19:24.593 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T15:19:25.208 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:19:25.248 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:19:25.269 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T15:19:26.119 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T15:19:26.203 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T15:19:26.243 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T15:19:26.333 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T15:19:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T15:19:26.373 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:19:26.457 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T15:19:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:19:26.491 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:19:26.584 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T15:19:26.655 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:19:29.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T15:19:29.072 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T15:19:29.073 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T15:19:29.074 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T15:19:29.075 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T15:19:29.076 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T15:19:29.077 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T15:19:29.078 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T15:19:29.079 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T15:19:29.080 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T15:19:29.081 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:19:29.082 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T15:19:31.318 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:19:31.318 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:31.318 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-04-25T15:19:31.318 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.318 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.319 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.320 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T15:19:31.321 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.322 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T15:19:31.323 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T15:19:31.324 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T15:19:31.325 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T15:19:31.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.327 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T15:19:31.328 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T15:19:31.329 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T15:19:31.330 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T15:19:31.330 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:31.330 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-04-25T15:19:31.730 DEBUG:teuthology.parallel:result is None 2024-04-25T15:19:32.710 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:19:32.710 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T15:19:32.710 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T15:19:32.710 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T15:19:32.710 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T15:19:32.710 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T15:19:32.710 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T15:19:32.711 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T15:19:32.712 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T15:19:32.724 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T15:19:32.724 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T15:19:32.724 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T15:19:32.724 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T15:19:32.724 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T15:19:32.724 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T15:19:32.724 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T15:19:32.724 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T15:19:32.725 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T15:19:32.726 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T15:19:32.727 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T15:19:32.728 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T15:19:32.729 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T15:19:32.730 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T15:19:32.731 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T15:19:32.732 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T15:19:32.733 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T15:19:32.733 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T15:19:32.733 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T15:19:32.733 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T15:19:32.733 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T15:19:34.830 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.831 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T15:19:34.832 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.833 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T15:19:34.834 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T15:19:34.835 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T15:19:34.836 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T15:19:34.837 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T15:19:34.838 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T15:19:34.839 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T15:19:34.840 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T15:19:34.841 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T15:19:34.842 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:34.842 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-25T15:19:35.258 DEBUG:teuthology.parallel:result is None 2024-04-25T15:19:35.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:19:35.417 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T15:19:35.443 INFO:teuthology.orchestra.run.smithi033.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T15:19:35.444 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T15:19:35.444 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T15:19:35.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:19:35.673 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T15:19:35.694 INFO:teuthology.orchestra.run.smithi155.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T15:19:35.695 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T15:19:35.695 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T15:19:35.696 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T15:19:35.697 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:35.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:19:35.729 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:19:35.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T15:19:35.761 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T15:19:35.761 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:35.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:19:35.798 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:19:35.866 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:19:35.866 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T15:19:35.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T15:19:35.956 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T15:19:35.956 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:35.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:19:35.984 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:19:36.052 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:19:36.052 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T15:19:36.077 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T15:19:36.141 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T15:19:36.142 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:36.142 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:19:36.170 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:19:36.239 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:19:36.239 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T15:19:36.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T15:19:36.327 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T15:19:36.414 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T15:19:36.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2024-04-25T15:19:36.417 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-04-25T15:19:36.444 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T15:19:36.444 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:19:36.487 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T15:19:36.514 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T15:19:36.514 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:19:36.557 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T15:19:36.589 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T15:19:36.589 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T15:19:36.589 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T15:19:36.589 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:36.589 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:19:36.641 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:19:36.759 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T15:19:36.787 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:19:36.787 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T15:19:36.802 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T15:19:36.912 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T15:19:36.940 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T15:19:36.940 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T15:19:36.940 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs/{frag test}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673205', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi033.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN2IE4umLPQgjAXP/4LUoszakM1pKwXoDlm4PCOR++AzahIueafSNGLT1goeK7oExyTvYBz6EGs6GTJS/N5Au8I=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiNR0sBCz6RKkA6AarxVmSGhVhS9zq34mYb+mHOmyoYmLiCIeg5VZTGWoeLOgEkkQRutixUcGYlsq+xbiE6Zvk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'client.0': ['libcephfs/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T15:19:36.941 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:19:36.944 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T15:19:36.990 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:19:37.001 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T15:19:37.055 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:37.055 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:19:37.085 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:19:37.086 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-04-25 15:19:23.625026067 +0000 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-04-25 15:17:26.124993147 +0000 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-04-25 15:17:26.124993147 +0000 2024-04-25T15:19:37.145 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-04-25 15:17:26.124993147 +0000 2024-04-25T15:19:37.146 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:19:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-04-25T15:19:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-04-25T15:19:37.213 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000259769 s, 2.0 MB/s 2024-04-25T15:19:37.215 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:19:37.275 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-04-25T15:19:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:19:37.334 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:19:37.334 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T15:19:37.334 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:19:37.334 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:19:37.334 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-04-25 15:19:23.626026051 +0000 2024-04-25T15:19:37.334 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-04-25 15:17:26.471987393 +0000 2024-04-25T15:19:37.334 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-04-25 15:17:26.471987393 +0000 2024-04-25T15:19:37.335 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-04-25 15:17:26.471987393 +0000 2024-04-25T15:19:37.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:19:37.402 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-04-25T15:19:37.402 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-04-25T15:19:37.402 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000239444 s, 2.1 MB/s 2024-04-25T15:19:37.403 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:19:37.462 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-04-25 15:19:23.626026051 +0000 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-04-25 15:17:26.874980710 +0000 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-04-25 15:17:26.874980710 +0000 2024-04-25T15:19:37.521 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-04-25 15:17:26.874980710 +0000 2024-04-25T15:19:37.522 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:19:37.588 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-04-25T15:19:37.588 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-04-25T15:19:37.588 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.00020238 s, 2.5 MB/s 2024-04-25T15:19:37.589 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:19:37.647 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-04-25T15:19:37.704 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:19:37.704 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:19:37.704 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T15:19:37.704 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:19:37.704 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:19:37.704 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-04-25 15:19:23.627026035 +0000 2024-04-25T15:19:37.704 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-04-25 15:17:27.223974923 +0000 2024-04-25T15:19:37.705 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-04-25 15:17:27.223974923 +0000 2024-04-25T15:19:37.705 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-04-25 15:17:27.223974923 +0000 2024-04-25T15:19:37.705 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:19:37.769 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-04-25T15:19:37.770 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-04-25T15:19:37.770 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000232053 s, 2.2 MB/s 2024-04-25T15:19:37.771 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:19:37.829 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:37.829 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:19:37.829 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T15:19:37.846 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T15:19:37.846 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-04-25T15:19:37.904 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T15:19:37.904 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:19:37.904 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T15:19:37.904 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:19:37.904 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:19:37.904 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 15:19:27.021461750 +0000 2024-04-25T15:19:37.905 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:17:23.096052153 +0000 2024-04-25T15:19:37.905 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:17:23.096052153 +0000 2024-04-25T15:19:37.905 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-25 15:17:23.096052153 +0000 2024-04-25T15:19:37.905 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T15:19:37.970 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T15:19:37.970 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T15:19:37.970 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000202643 s, 2.5 MB/s 2024-04-25T15:19:37.972 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T15:19:38.030 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-04-25T15:19:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T15:19:38.086 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:19:38.086 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T15:19:38.087 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:19:38.087 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:19:38.087 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 15:19:27.021461750 +0000 2024-04-25T15:19:38.087 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:17:23.438044649 +0000 2024-04-25T15:19:38.087 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:17:23.438044649 +0000 2024-04-25T15:19:38.087 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-25 15:17:23.438044649 +0000 2024-04-25T15:19:38.087 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T15:19:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T15:19:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T15:19:38.151 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000212919 s, 2.4 MB/s 2024-04-25T15:19:38.152 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T15:19:38.209 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-04-25T15:19:38.264 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T15:19:38.264 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:19:38.264 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-04-25T15:19:38.264 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:19:38.264 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:19:38.264 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 15:19:27.022461729 +0000 2024-04-25T15:19:38.264 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:17:23.776037233 +0000 2024-04-25T15:19:38.265 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:17:23.776037233 +0000 2024-04-25T15:19:38.265 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-25 15:17:23.776037233 +0000 2024-04-25T15:19:38.265 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T15:19:38.327 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T15:19:38.327 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T15:19:38.327 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000184567 s, 2.8 MB/s 2024-04-25T15:19:38.328 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T15:19:38.384 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-04-25T15:19:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T15:19:38.439 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T15:19:38.439 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T15:19:38.439 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T15:19:38.439 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T15:19:38.439 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 15:19:27.022461729 +0000 2024-04-25T15:19:38.440 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 15:17:24.115029796 +0000 2024-04-25T15:19:38.440 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 15:17:24.115029796 +0000 2024-04-25T15:19:38.440 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-25 15:17:24.115029796 +0000 2024-04-25T15:19:38.440 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T15:19:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T15:19:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T15:19:38.502 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000206301 s, 2.5 MB/s 2024-04-25T15:19:38.503 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T15:19:38.559 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:38.560 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:19:38.560 INFO:tasks.ceph:Generating config... 2024-04-25T15:19:38.561 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T15:19:38.561 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T15:19:38.561 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T15:19:38.561 INFO:tasks.ceph:[client] pid file = 2024-04-25T15:19:38.561 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T15:19:38.561 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T15:19:38.561 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T15:19:38.561 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T15:19:38.561 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T15:19:38.561 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T15:19:38.562 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T15:19:38.563 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T15:19:38.563 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T15:19:38.563 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T15:19:38.564 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T15:19:38.564 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T15:19:38.564 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T15:19:38.564 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T15:19:38.564 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T15:19:38.564 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T15:19:38.631 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T15:19:38.635 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T15:19:38.692 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:19:38.717 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.33'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2024-04-25T15:19:38.717 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.33,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T15:19:38.718 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:38.718 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:19:38.774 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.33 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:38.872 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:38.872 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: generated fsid 674605f9-f613-4a95-b0f3-ac5870429d94 2024-04-25T15:19:38.872 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = quincy 2024-04-25T15:19:38.872 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 0 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 674605f9-f613-4a95-b0f3-ac5870429d94 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:last_changed 2024-04-25T15:19:38.872252+0000 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-04-25T15:19:38.872252+0000 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:min_mon_release 17 (quincy) 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:election_strategy: 1 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2024-04-25T15:19:38.873 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T15:19:38.874 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T15:19:38.890 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 674605f9-f613-4a95-b0f3-ac5870429d94... 2024-04-25T15:19:38.891 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:19:38.933 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T15:19:38.972 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-04-25T15:19:38.972 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2024-04-25T15:19:38.972 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:19:38.972 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.973 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2024-04-25T15:19:38.974 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.33,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 674605f9-f613-4a95-b0f3-ac5870429d94 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2024-04-25T15:19:38.975 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug trim objects = true 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.976 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = bitmap 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2024-04-25T15:19:38.977 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2024-04-25T15:19:38.978 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2024-04-25T15:19:38.979 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.980 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: mon down mkfs grace = 300 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: mon op complaint time = 120 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = true 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: client mount timeout = 600 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = "" 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2024-04-25T15:19:38.981 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout:[mds] 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds = 20 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds balancer = 20 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: mds bal fragment size max = 10000 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: mds bal merge size = 5 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: mds bal split bits = 3 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: mds bal split size = 100 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug frag = True 2024-04-25T15:19:38.982 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug scatterstat = True 2024-04-25T15:19:38.983 INFO:teuthology.orchestra.run.smithi033.stdout: mds op complaint time = 180 2024-04-25T15:19:38.983 INFO:teuthology.orchestra.run.smithi033.stdout: mds verify scatter = True 2024-04-25T15:19:38.983 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2024-04-25T15:19:38.983 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2024-04-25T15:19:38.983 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2024-04-25T15:19:38.983 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.984 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-04-25T15:19:38.985 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.986 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.33,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 674605f9-f613-4a95-b0f3-ac5870429d94 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.987 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-04-25T15:19:38.988 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-04-25T15:19:38.989 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.990 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.991 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-04-25T15:19:38.992 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-04-25T15:19:38.993 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-04-25T15:19:38.994 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-04-25T15:19:38.996 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T15:19:38.996 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T15:19:39.099 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T15:19:39.099 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:39.099 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T15:19:39.114 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:39.114 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T15:19:39.170 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:19:39.170 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:39.171 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:19:39.171 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:19:39.244 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:19:39.244 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:39.299 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:19:39.299 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:19:39.300 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T15:19:39.300 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T15:19:39.333 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:19:39.333 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:39.388 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T15:19:39.388 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T15:19:39.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:19:39.447 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T15:19:39.450 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:19:39.531 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T15:19:39.534 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T15:19:39.534 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:19:39.594 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T15:19:39.597 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T15:19:39.622 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:19:39.681 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T15:19:39.684 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T15:19:39.707 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T15:19:39.708 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T15:19:39.757 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T15:19:39.770 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T15:19:39.771 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T15:19:39.771 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T15:19:39.795 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:39.795 INFO:tasks.ceph:role: osd.0 2024-04-25T15:19:39.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:19:39.795 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:19:39.867 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:19:39.867 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:19:39.867 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:19:39.867 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:19:39.867 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:19:39.867 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:19:39.867 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:19:39.868 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:19:39.868 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:19:39.868 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:19:40.368 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-04-25T15:19:40.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-04-25T15:19:40.370 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T15:19:40.487 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T15:19:40.520 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T15:19:40.586 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:40.586 INFO:tasks.ceph:role: osd.1 2024-04-25T15:19:40.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:19:40.587 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:19:40.659 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:19:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:19:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:19:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:19:40.659 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:19:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:19:40.659 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:19:40.659 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:19:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:19:40.660 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:19:41.116 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-04-25T15:19:41.118 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-04-25T15:19:41.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T15:19:41.202 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T15:19:41.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T15:19:41.336 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:41.336 INFO:tasks.ceph:role: osd.2 2024-04-25T15:19:41.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:19:41.336 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:19:41.408 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:19:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:19:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:19:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:19:41.409 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:19:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:19:41.409 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:19:41.409 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:19:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:19:41.409 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:19:41.902 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-04-25T15:19:41.904 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-04-25T15:19:41.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T15:19:42.042 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T15:19:42.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T15:19:42.138 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:42.138 INFO:tasks.ceph:role: osd.3 2024-04-25T15:19:42.138 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:19:42.138 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:19:42.210 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:19:42.211 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:19:42.731 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2024-04-25T15:19:42.733 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2024-04-25T15:19:42.733 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T15:19:42.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T15:19:42.888 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:43.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:43.000+0000 7f995a810640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T15:19:43.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:43.001+0000 7f995a810640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T15:19:43.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:43.001+0000 7f995a810640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:19:43.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:43.001+0000 7f995a810640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:19:43.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:43.001+0000 7f995a810640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T15:19:43.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:43.001+0000 7f995a810640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T15:19:45.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T15:19:45.883 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:45.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:45.984+0000 7f8294a22640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T15:19:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:45.985+0000 7f8294a22640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T15:19:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:45.985+0000 7f8294a22640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:19:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:45.985+0000 7f8294a22640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:19:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:45.985+0000 7f8294a22640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T15:19:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:45.985+0000 7f8294a22640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T15:19:48.838 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T15:19:48.868 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:48.969+0000 7f0d5ae31640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T15:19:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:48.970+0000 7f0d5ae31640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T15:19:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:48.970+0000 7f0d5ae31640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:19:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:48.970+0000 7f0d5ae31640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:19:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:48.970+0000 7f0d5ae31640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T15:19:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:48.970+0000 7f0d5ae31640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T15:19:51.831 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T15:19:51.860 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:51.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:51.966+0000 7fa62e631640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T15:19:51.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:51.967+0000 7fa62e631640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T15:19:51.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:51.967+0000 7fa62e631640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:19:51.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:51.967+0000 7fa62e631640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:19:51.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:51.967+0000 7fa62e631640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T15:19:51.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:19:51.967+0000 7fa62e631640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T15:19:54.833 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T15:19:54.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T15:19:54.891 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:54.891 INFO:tasks.ceph:role: osd.4 2024-04-25T15:19:54.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:19:54.891 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:19:54.965 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:19:55.483 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T15:19:55.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T15:19:55.486 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T15:19:55.602 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T15:19:55.632 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T15:19:55.696 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:55.697 INFO:tasks.ceph:role: osd.5 2024-04-25T15:19:55.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:19:55.697 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T15:19:55.767 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:19:55.768 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:19:56.233 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T15:19:56.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T15:19:56.236 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T15:19:56.321 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T15:19:56.349 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T15:19:56.412 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:56.412 INFO:tasks.ceph:role: osd.6 2024-04-25T15:19:56.412 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:19:56.413 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T15:19:56.484 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:19:56.484 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:19:56.484 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:19:56.485 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:19:56.485 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:19:56.485 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:19:56.485 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:19:56.485 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:19:56.485 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:19:56.485 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:19:56.974 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T15:19:56.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T15:19:56.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T15:19:57.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T15:19:57.163 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T15:19:57.227 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T15:19:57.227 INFO:tasks.ceph:role: osd.7 2024-04-25T15:19:57.227 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:19:57.227 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T15:19:57.298 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T15:19:57.298 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T15:19:57.299 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T15:19:57.299 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T15:19:57.299 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T15:19:57.299 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T15:19:57.299 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T15:19:57.299 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T15:19:57.299 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T15:19:57.299 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T15:19:57.805 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T15:19:57.807 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T15:19:57.807 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T15:19:57.954 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T15:19:57.986 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:19:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:19:58.097+0000 7f3e7c118640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T15:19:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:19:58.097+0000 7f3e7c118640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T15:19:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:19:58.097+0000 7f3e7c118640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:19:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:19:58.097+0000 7f3e7c118640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:19:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:19:58.097+0000 7f3e7c118640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T15:19:58.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:19:58.098+0000 7f3e7c118640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T15:20:00.951 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T15:20:00.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:20:01.076 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:01.075+0000 7fc2bc061640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T15:20:01.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:01.076+0000 7fc2bc061640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T15:20:01.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:01.076+0000 7fc2bc061640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:20:01.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:01.076+0000 7fc2bc061640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:20:01.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:01.076+0000 7fc2bc061640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T15:20:01.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:01.076+0000 7fc2bc061640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T15:20:03.925 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T15:20:03.950 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:20:04.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:04.045+0000 7f6ba2ba7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T15:20:04.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:04.045+0000 7f6ba2ba7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T15:20:04.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:04.045+0000 7f6ba2ba7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:20:04.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:04.045+0000 7f6ba2ba7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:20:04.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:04.045+0000 7f6ba2ba7640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T15:20:04.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:04.046+0000 7f6ba2ba7640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T15:20:06.899 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T15:20:06.923 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:20:06.942 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:20:06.945 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:20:07.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:07.016+0000 7f6e401d4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T15:20:07.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:07.017+0000 7f6e401d4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T15:20:07.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:07.017+0000 7f6e401d4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:20:07.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:07.017+0000 7f6e401d4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:20:07.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:07.017+0000 7f6e401d4640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T15:20:07.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:07.017+0000 7f6e401d4640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T15:20:09.863 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T15:20:09.932 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T15:20:09.932 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:09.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T15:20:09.963 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:09.963 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T15:20:10.031 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:10.031 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T15:20:10.098 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:10.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T15:20:10.164 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:10.165 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T15:20:10.231 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:10.231 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T15:20:10.297 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:10.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T15:20:10.324 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:10.324 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T15:20:10.389 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:10.389 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T15:20:10.456 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:10.456 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T15:20:10.522 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:10.522 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T15:20:10.586 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:10.587 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T15:20:10.652 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:10.652 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T15:20:10.669 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T15:20:10.669 DEBUG:teuthology.orchestra.run.smithi033:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:20:10.712 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T15:20:10.734 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2024-04-25T15:20:10.734 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCLdCpmRPOrGhAAaIeoibMfaLy6d2eiacVHAA== 2024-04-25T15:20:10.734 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-04-25T15:20:10.734 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCLdCpmO9BmIxAA3qOsy4z1JcYO+Ahh3jwUbg== 2024-04-25T15:20:10.734 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCPdCpmEt0eABAAy9jmFShLpDNMTcAJyOHPrw== 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCRdCpmFfjEOhAA3AdcWrVELQ+wkymSuK31zA== 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCUdCpmrWnfORAAs5dmxZKoh9ln1bpaBnIC6g== 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCXdCpmT/a1ORAAYmC/+Nk4AX5O3OulOPh5yA== 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCLdCpmy8moHxAAOHNJxw7wwSCr+rwEE6nuhA== 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCLdCpmlqSZKBAAnLKX7qQJCWvviwJE1XGBjw== 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCedCpmZ6rdBRAAU5fCcXZ7S/8yKpdM5VUvcg== 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2024-04-25T15:20:10.735 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQChdCpmJlWVBBAAfGAZOZEZ+ol8vyC80cAHLA== 2024-04-25T15:20:10.736 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2024-04-25T15:20:10.736 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCkdCpmTT/GAhAAyquvScI+X35GTSGUBLP5Ig== 2024-04-25T15:20:10.736 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2024-04-25T15:20:10.736 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCndCpmaMIQARAAfHwsmZYe3I7iKn9kefpY9g== 2024-04-25T15:20:10.736 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2024-04-25T15:20:10.736 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQCLdCpmtZ8iLRAACN5TO/jJbxS3mRr4DZNFJg== 2024-04-25T15:20:10.736 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.y] 2024-04-25T15:20:10.736 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCLdCpmRPOrGhAAaIeoibMfaLy6d2eiacVHAA== 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCLdCpmO9BmIxAA3qOsy4z1JcYO+Ahh3jwUbg== 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.0] 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCPdCpmEt0eABAAy9jmFShLpDNMTcAJyOHPrw== 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.1] 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCRdCpmFfjEOhAA3AdcWrVELQ+wkymSuK31zA== 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.2] 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCUdCpmrWnfORAAs5dmxZKoh9ln1bpaBnIC6g== 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.3] 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCXdCpmT/a1ORAAYmC/+Nk4AX5O3OulOPh5yA== 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.x] 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCLdCpmy8moHxAAOHNJxw7wwSCr+rwEE6nuhA== 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2024-04-25T15:20:10.737 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCLdCpmlqSZKBAAnLKX7qQJCWvviwJE1XGBjw== 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.4] 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCedCpmZ6rdBRAAU5fCcXZ7S/8yKpdM5VUvcg== 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.5] 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQChdCpmJlWVBBAAfGAZOZEZ+ol8vyC80cAHLA== 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.6] 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCkdCpmTT/GAhAAyquvScI+X35GTSGUBLP5Ig== 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.7] 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCndCpmaMIQARAAfHwsmZYe3I7iKn9kefpY9g== 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-04-25T15:20:10.738 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCLdCpmtZ8iLRAACN5TO/jJbxS3mRr4DZNFJg== 2024-04-25T15:20:10.740 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:20:10.783 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:20:10.847 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:20:10.849 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:20:10.913 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:10.915 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:10.975 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:10.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.039 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.100 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.159 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:20:11.161 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T15:20:11.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:20:11.223 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T15:20:11.284 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.286 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.344 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.347 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.405 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.407 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.468 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.470 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T15:20:11.530 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:20:11.533 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T15:20:11.596 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T15:20:11.596 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T15:20:11.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:20:11.728 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T15:20:11.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T15:20:11.780 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:20:11.885 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T15:20:11.908 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T15:20:11.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T15:20:12.078 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T15:20:12.101 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:20:12.103 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T15:20:12.155 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T15:20:12.156 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T15:20:12.156 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T15:20:12.159 INFO:tasks.ceph.mon.a:Started 2024-04-25T15:20:12.159 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T15:20:12.159 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T15:20:12.199 INFO:tasks.ceph.mon.b:Started 2024-04-25T15:20:12.199 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T15:20:12.199 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T15:20:12.202 INFO:tasks.ceph.mon.c:Started 2024-04-25T15:20:12.202 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T15:20:12.202 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T15:20:12.203 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T15:20:12.205 INFO:tasks.ceph.mgr.y:Started 2024-04-25T15:20:12.206 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T15:20:12.206 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T15:20:12.209 INFO:tasks.ceph.mgr.x:Started 2024-04-25T15:20:12.209 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T15:20:12.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T15:20:12.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.322+0000 7f765e051640 1 Processor -- start 2024-04-25T15:20:12.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.322+0000 7f765e051640 1 -- start start 2024-04-25T15:20:12.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.323+0000 7f765e051640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:12.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.323+0000 7f765e051640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:12.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.323+0000 7f765e051640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76580723e0 con 0x7f76580bc140 2024-04-25T15:20:12.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.323+0000 7f765e051640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f7658072a30 con 0x7f7658073a80 2024-04-25T15:20:12.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.323+0000 7f765e051640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f76580726c0 con 0x7f7658141890 2024-04-25T15:20:12.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.323+0000 7f7656ffd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:12.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.323+0000 7f7656ffd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41408/0 (socket says 172.21.15.33:41408) 2024-04-25T15:20:12.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.323+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 learned_addr learned my addr 172.21.15.33:0/1588648422 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:12.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:20:12.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:12.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:12.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:20:12.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:12.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:20:12.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:12.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:12.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.324+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:20:12.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:12.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:20:12.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:12.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:12.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:20:12.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:12.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:20:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.525+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:12.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:12.926+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:13.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:13.727+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:20:15.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f76557fa640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7658151e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:20:15.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f76557fa640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7658151e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:15.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f76557fa640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 msgr2=0x7f7658141350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:20:15.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f76557fa640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.33:3300/0 conn(0x7f7658073a80 0x7f7658141350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f76557fa640 1 -- 172.21.15.33:0/1588648422 >> v1:172.21.15.155:6789/0 conn(0x7f76580bc140 legacy=0x7f76580b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f76557fa640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f76557fa640 1 -- 172.21.15.33:0/1588648422 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76580b6250 con 0x7f76440036c0 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f76557fa640 1 -- 172.21.15.33:0/1588648422 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7658072a30 con 0x7f76440073a0 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.324+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T15:20:15.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.525+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:15.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.525+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:20:15.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.525+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:15.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.525+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:15.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.525+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T15:20:15.928 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.927+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:15.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.927+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:20:15.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.927+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:15.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.927+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:15.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:15.927+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T15:20:16.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:16.729+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:16.729 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:16.729+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T15:20:16.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:16.729+0000 7f7656ffd640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T15:20:16.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:16.729+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T15:20:16.730 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:16.729+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T15:20:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.493+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063902878 0 0) 0x7f76580b6250 con 0x7f76440036c0 2024-04-25T15:20:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.493+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7640003520 con 0x7f76440036c0 2024-04-25T15:20:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 157291414 0 0) 0x7f7640003520 con 0x7f76440036c0 2024-04-25T15:20:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 msgr2=0x7f7644009890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:20:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 --2- 172.21.15.33:0/1588648422 >> v2:172.21.15.155:3300/0 conn(0x7f76440073a0 0x7f7644009890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764400af90 con 0x7f76440036c0 2024-04-25T15:20:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7f76480016f0 con 0x7f76440036c0 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 >> v1:172.21.15.33:6789/0 conn(0x7f76440036c0 legacy=0x7f7644005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f7657fff640 1 -- 172.21.15.33:0/1588648422 reap_dead start 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7640003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7640004060 0x7f7640004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f764000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7658072a30 con 0x7f7640004060 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7640005690 con 0x7f7640004e60 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f764000bf80 con 0x7f7658141890 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f76577fe640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7640003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f764000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.495+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7640004060 0x7f7640004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.496+0000 7f76577fe640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 msgr2=0x7f764000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.496+0000 7f76577fe640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f764000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.496+0000 7f76577fe640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7640004060 msgr2=0x7f7640004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.496+0000 7f76577fe640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7640004060 0x7f7640004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.496+0000 7f76577fe640 1 -- 172.21.15.33:0/1588648422 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7640003520 con 0x7f7658141890 2024-04-25T15:20:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.496+0000 7f7657fff640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f764000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.496+0000 7f7656ffd640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7640004060 0x7f7640004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.497+0000 7f76577fe640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7640003a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7648007f40 tx=0x7f7640005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d250ecd03562f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.497+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648007b90 con 0x7f7658141890 2024-04-25T15:20:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.497+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7648031600 con 0x7f7658141890 2024-04-25T15:20:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.497+0000 7f76567fc640 1 -- 172.21.15.33:0/1588648422 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76480319f0 con 0x7f7658141890 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 -- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 msgr2=0x7f7640003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7640003a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7648007f40 tx=0x7f7640005830 comp rx=0 tx=0).stop 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 -- 172.21.15.33:0/1588648422 shutdown_connections 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f764000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7640004060 0x7f7640004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 --2- 172.21.15.33:0/1588648422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7658141890 0x7f7640003a00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 -- 172.21.15.33:0/1588648422 >> 172.21.15.33:0/1588648422 conn(0x7f76580b8b10 msgr2=0x7f76580bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 -- 172.21.15.33:0/1588648422 shutdown_connections 2024-04-25T15:20:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.499+0000 7f765e051640 1 -- 172.21.15.33:0/1588648422 wait complete. 2024-04-25T15:20:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.501+0000 7f765e051640 1 Processor -- start 2024-04-25T15:20:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.502+0000 7f765e051640 1 -- start start 2024-04-25T15:20:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f765e051640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7640004060 0x7f76581cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f765e051640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f76581da6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f765e051640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7658141890 0x7f765813a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f765e051640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7658073e90 con 0x7f7658141890 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f765e051640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7658072ec0 con 0x7f7640004e60 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f765e051640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f76580b28f0 con 0x7f7640004060 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f7657fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7658141890 0x7f765813a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f76581da6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f76577fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7640004060 0x7f76581cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f7656ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f76581da6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:36492/0 (socket says 172.21.15.33:36492) 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f7657fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7658141890 0x7f765813a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52804/0 (socket says 172.21.15.33:52804) 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.503+0000 7f7656ffd640 1 -- 172.21.15.33:0/2633478916 learned_addr learned my addr 172.21.15.33:0/2633478916 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f7656ffd640 1 -- 172.21.15.33:0/2633478916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7640004060 msgr2=0x7f76581cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f7656ffd640 1 --2- 172.21.15.33:0/2633478916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7640004060 0x7f76581cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f7656ffd640 1 -- 172.21.15.33:0/2633478916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7658141890 msgr2=0x7f765813a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f7656ffd640 1 --2- 172.21.15.33:0/2633478916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7658141890 0x7f765813a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f7656ffd640 1 -- 172.21.15.33:0/2633478916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76581dac00 con 0x7f7640004e60 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f76577fe640 1 --2- 172.21.15.33:0/2633478916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7640004060 0x7f76581cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f7656ffd640 1 --2- 172.21.15.33:0/2633478916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f76581da6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f764c016a20 tx=0x7f764c016e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f763ffff640 1 -- 172.21.15.33:0/2633478916 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c027020 con 0x7f7640004e60 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f763ffff640 1 -- 172.21.15.33:0/2633478916 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c015d50 con 0x7f7640004e60 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f763ffff640 1 -- 172.21.15.33:0/2633478916 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c023620 con 0x7f7640004e60 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.504+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76581cf070 con 0x7f7640004e60 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.505+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76581d0510 con 0x7f7640004e60 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.505+0000 7f763ffff640 1 -- 172.21.15.33:0/2633478916 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f764c02a020 con 0x7f7640004e60 2024-04-25T15:20:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.505+0000 7f763ffff640 1 -- 172.21.15.33:0/2633478916 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f764c00f020 con 0x7f7640004e60 2024-04-25T15:20:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.506+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76580764e0 con 0x7f7640004e60 2024-04-25T15:20:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.509+0000 7f763ffff640 1 -- 172.21.15.33:0/2633478916 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f764c031020 con 0x7f7640004e60 2024-04-25T15:20:17.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.578+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f765813e0d0 con 0x7f7640004e60 2024-04-25T15:20:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.582+0000 7f763ffff640 1 -- 172.21.15.33:0/2633478916 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f764c020040 con 0x7f7640004e60 2024-04-25T15:20:17.583 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-04-25T15:20:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.583+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 msgr2=0x7f76581da6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.583+0000 7f765e051640 1 --2- 172.21.15.33:0/2633478916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f76581da6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f764c016a20 tx=0x7f764c016e20 comp rx=0 tx=0).stop 2024-04-25T15:20:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.583+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 shutdown_connections 2024-04-25T15:20:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.583+0000 7f765e051640 1 --2- 172.21.15.33:0/2633478916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7658141890 0x7f765813a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.583+0000 7f765e051640 1 --2- 172.21.15.33:0/2633478916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640004e60 0x7f76581da6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.583+0000 7f765e051640 1 --2- 172.21.15.33:0/2633478916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7640004060 0x7f76581cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.583+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 >> 172.21.15.33:0/2633478916 conn(0x7f76580b8b10 msgr2=0x7f76581410e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.584+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 shutdown_connections 2024-04-25T15:20:17.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:17.584+0000 7f765e051640 1 -- 172.21.15.33:0/2633478916 wait complete. 2024-04-25T15:20:17.596 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T15:20:17.596 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T15:20:17.597 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:17.597 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T15:20:17.612 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:17.611+0000 7fae5b42e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:20:17.616 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:17.615+0000 7ff14e61b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T15:20:17.622 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:17.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T15:20:17.687 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:17.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T15:20:17.752 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:20:17.752 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T15:20:17.769 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:17.769+0000 7ff14e61b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:20:17.771 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:17.770+0000 7fae5b42e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:20:17.793 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:17.793 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T15:20:17.818 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:17.818 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T15:20:17.826 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:17.825+0000 7fae5b42e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:20:17.826 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:17.826+0000 7ff14e61b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T15:20:17.849 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:17.849 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T15:20:17.912 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T15:20:17.913 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T15:20:17.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 727fa4ab-1326-4836-bb36-1e6f1894a061 0 2024-04-25T15:20:18.082 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:18.082+0000 7ff14e61b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:20:18.090 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:18.089+0000 7fae5b42e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T15:20:18.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.123+0000 7f5da16ca640 1 Processor -- start 2024-04-25T15:20:18.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.123+0000 7f5da16ca640 1 -- start start 2024-04-25T15:20:18.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5da16ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5da16ca640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5d9c0be0e0 0x7f5d9c0bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5da16ca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5d9c0be4f0 0x7f5d9c09d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5da16ca640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f5d9c14a820 con 0x7f5d9c0be0e0 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5da16ca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5d9c149d40 con 0x7f5d9c0be4f0 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5da16ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c14a020 con 0x7f5d9c149840 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5d9c0be4f0 0x7f5d9c09d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c06d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37736/0 (socket says 172.21.15.155:37736) 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5d9c0be4f0 0x7f5d9c09d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:32832/0 (socket says 172.21.15.155:32832) 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9affd640 1 -- 172.21.15.155:0/1218668622 learned_addr learned my addr 172.21.15.155:0/1218668622 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9a7fc640 1 --2- 172.21.15.155:0/1218668622 >> v2:172.21.15.33:3300/0 conn(0x7f5d9c0be0e0 0x7f5d9c0bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9affd640 1 -- 172.21.15.155:0/1218668622 >> v2:172.21.15.155:3300/0 conn(0x7f5d9c0be4f0 msgr2=0x7f5d9c09d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9affd640 1 --2- 172.21.15.155:0/1218668622 >> v2:172.21.15.155:3300/0 conn(0x7f5d9c0be4f0 0x7f5d9c09d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9affd640 1 -- 172.21.15.155:0/1218668622 >> v2:172.21.15.33:3300/0 conn(0x7f5d9c0be0e0 msgr2=0x7f5d9c0bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9affd640 1 --2- 172.21.15.155:0/1218668622 >> v2:172.21.15.33:3300/0 conn(0x7f5d9c0be0e0 0x7f5d9c0bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9affd640 1 -- 172.21.15.155:0/1218668622 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c14a300 con 0x7f5d9c149840 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9a7fc640 1 --2- 172.21.15.155:0/1218668622 >> v2:172.21.15.33:3300/0 conn(0x7f5d9c0be0e0 0x7f5d9c0bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.124+0000 7f5d9b7fe640 1 --2- 172.21.15.155:0/1218668622 >> v2:172.21.15.155:3300/0 conn(0x7f5d9c0be4f0 0x7f5d9c09d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.125+0000 7f5d9affd640 1 --2- 172.21.15.155:0/1218668622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c06d230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0744f0 tx=0x7f5d8c02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a3977df7d2b00d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.125+0000 7f5d99ffb640 1 -- 172.21.15.155:0/1218668622 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c037070 con 0x7f5d9c149840 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.125+0000 7f5d99ffb640 1 -- 172.21.15.155:0/1218668622 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8c032440 con 0x7f5d9c149840 2024-04-25T15:20:18.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.125+0000 7f5d99ffb640 1 -- 172.21.15.155:0/1218668622 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c032810 con 0x7f5d9c149840 2024-04-25T15:20:18.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 -- 172.21.15.155:0/1218668622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 msgr2=0x7f5d9c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 --2- 172.21.15.155:0/1218668622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c06d230 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0744f0 tx=0x7f5d8c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 -- 172.21.15.155:0/1218668622 shutdown_connections 2024-04-25T15:20:18.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 --2- 172.21.15.155:0/1218668622 >> v2:172.21.15.155:3300/0 conn(0x7f5d9c0be4f0 0x7f5d9c09d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 --2- 172.21.15.155:0/1218668622 >> v2:172.21.15.33:3300/0 conn(0x7f5d9c0be0e0 0x7f5d9c0bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 --2- 172.21.15.155:0/1218668622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c06d230 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 -- 172.21.15.155:0/1218668622 >> 172.21.15.155:0/1218668622 conn(0x7f5d9c0bebf0 msgr2=0x7f5d9c0bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 -- 172.21.15.155:0/1218668622 shutdown_connections 2024-04-25T15:20:18.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.126+0000 7f5da16ca640 1 -- 172.21.15.155:0/1218668622 wait complete. 2024-04-25T15:20:18.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.128+0000 7f5da16ca640 1 Processor -- start 2024-04-25T15:20:18.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.128+0000 7f5da16ca640 1 -- start start 2024-04-25T15:20:18.131 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:18.129+0000 7ff14e61b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5da16ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d9c0be0e0 0x7f5d9c0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5da16ca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c0be4f0 0x7f5d9c1e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5da16ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c1df9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5da16ca640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c09d920 con 0x7f5d9c0be4f0 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5da16ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c0bd180 con 0x7f5d9c0be0e0 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5da16ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9c09daa0 con 0x7f5d9c149840 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d9c0be0e0 0x7f5d9c0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c1df9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d9c0be0e0 0x7f5d9c0b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:32846/0 (socket says 172.21.15.155:32846) 2024-04-25T15:20:18.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c1df9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37752/0 (socket says 172.21.15.155:37752) 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9affd640 1 -- 172.21.15.155:0/2714583646 learned_addr learned my addr 172.21.15.155:0/2714583646 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9a7fc640 1 --2- 172.21.15.155:0/2714583646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c0be4f0 0x7f5d9c1e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9b7fe640 1 -- 172.21.15.155:0/2714583646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d9c0be0e0 msgr2=0x7f5d9c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9b7fe640 1 --2- 172.21.15.155:0/2714583646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d9c0be0e0 0x7f5d9c0b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9b7fe640 1 -- 172.21.15.155:0/2714583646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c0be4f0 msgr2=0x7f5d9c1e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9b7fe640 1 --2- 172.21.15.155:0/2714583646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c0be4f0 0x7f5d9c1e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9b7fe640 1 -- 172.21.15.155:0/2714583646 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c1e3680 con 0x7f5d9c149840 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.129+0000 7f5d9b7fe640 1 --2- 172.21.15.155:0/2714583646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c1df9b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400ef90 tx=0x7f5d9400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.130+0000 7f5d937fe640 1 -- 172.21.15.155:0/2714583646 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94018030 con 0x7f5d9c149840 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.130+0000 7f5d937fe640 1 -- 172.21.15.155:0/2714583646 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9400cd30 con 0x7f5d9c149840 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.130+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c1df4f0 con 0x7f5d9c149840 2024-04-25T15:20:18.134 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.130+0000 7f5d937fe640 1 -- 172.21.15.155:0/2714583646 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94003bb0 con 0x7f5d9c149840 2024-04-25T15:20:18.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.130+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c0b4d70 con 0x7f5d9c149840 2024-04-25T15:20:18.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.130+0000 7f5d937fe640 1 -- 172.21.15.155:0/2714583646 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d94005d10 con 0x7f5d9c149840 2024-04-25T15:20:18.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.130+0000 7f5d937fe640 1 -- 172.21.15.155:0/2714583646 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5d9401d7e0 con 0x7f5d9c149840 2024-04-25T15:20:18.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.131+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9c0ba9c0 con 0x7f5d9c149840 2024-04-25T15:20:18.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.133+0000 7f5d937fe640 1 -- 172.21.15.155:0/2714583646 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5d9c0ba9c0 con 0x7f5d9c149840 2024-04-25T15:20:18.138 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:18.137+0000 7fae5b42e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T15:20:18.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.205+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "727fa4ab-1326-4836-bb36-1e6f1894a061", "id": 0} v 0) -- 0x7f5d9c1e2a10 con 0x7f5d9c149840 2024-04-25T15:20:18.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.209+0000 7f5d937fe640 1 -- 172.21.15.155:0/2714583646 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "727fa4ab-1326-4836-bb36-1e6f1894a061", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5d94022070 con 0x7f5d9c149840 2024-04-25T15:20:18.210 INFO:teuthology.orchestra.run.smithi155.stdout:0 2024-04-25T15:20:18.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 msgr2=0x7f5d9c1df9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 --2- 172.21.15.155:0/2714583646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c1df9b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400ef90 tx=0x7f5d9400c490 comp rx=0 tx=0).stop 2024-04-25T15:20:18.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 shutdown_connections 2024-04-25T15:20:18.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 --2- 172.21.15.155:0/2714583646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9c149840 0x7f5d9c1df9b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 --2- 172.21.15.155:0/2714583646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d9c0be4f0 0x7f5d9c1e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 --2- 172.21.15.155:0/2714583646 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d9c0be0e0 0x7f5d9c0b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 >> 172.21.15.155:0/2714583646 conn(0x7f5d9c0bebf0 msgr2=0x7f5d9c0bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 shutdown_connections 2024-04-25T15:20:18.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.210+0000 7f5da16ca640 1 -- 172.21.15.155:0/2714583646 wait complete. 2024-04-25T15:20:18.222 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 3a03cc6c-497d-4b8d-a588-5522635c93c5 1 2024-04-25T15:20:18.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.327+0000 7ff7cc13c640 1 Processor -- start 2024-04-25T15:20:18.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.327+0000 7ff7cc13c640 1 -- start start 2024-04-25T15:20:18.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7cc13c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7c40b5780 0x7ff7c4146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7cc13c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c40b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7cc13c640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c40b7f80 con 0x7ff7c40b68b0 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7cc13c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c40724b0 con 0x7ff7c40b5780 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7cc13c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c41466e0 con 0x7ff7c41470b0 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c96d7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c40b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c9ed8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7c40b5780 0x7ff7c4146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c96d7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c40b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37754/0 (socket says 172.21.15.155:37754) 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c9ed8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7c40b5780 0x7ff7c4146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:32848/0 (socket says 172.21.15.155:32848) 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c96d7640 1 -- 172.21.15.155:0/3865467470 learned_addr learned my addr 172.21.15.155:0/3865467470 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c9ed8640 1 -- 172.21.15.155:0/3865467470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 msgr2=0x7ff7c40b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c9ed8640 1 --2- 172.21.15.155:0/3865467470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c40b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c9ed8640 1 -- 172.21.15.155:0/3865467470 >> v1:172.21.15.33:6789/0 conn(0x7ff7c40b68b0 legacy=0x7ff7c4149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c9ed8640 1 -- 172.21.15.155:0/3865467470 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c40b2e30 con 0x7ff7c40b5780 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.329+0000 7ff7c96d7640 1 --2- 172.21.15.155:0/3865467470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c40b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.330+0000 7ff7c9ed8640 1 --2- 172.21.15.155:0/3865467470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b5780 0x7ff7c4146b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40097a0 tx=0x7ff7b402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b18a21ad812c47f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.330+0000 7ff7c8ed6640 1 -- 172.21.15.155:0/3865467470 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4037070 con 0x7ff7c40b5780 2024-04-25T15:20:18.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.330+0000 7ff7c8ed6640 1 -- 172.21.15.155:0/3865467470 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b402adb0 con 0x7ff7c40b5780 2024-04-25T15:20:18.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.330+0000 7ff7c8ed6640 1 -- 172.21.15.155:0/3865467470 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4032660 con 0x7ff7c40b5780 2024-04-25T15:20:18.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.331+0000 7ff7cc13c640 1 -- 172.21.15.155:0/3865467470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b5780 msgr2=0x7ff7c4146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.331+0000 7ff7cc13c640 1 --2- 172.21.15.155:0/3865467470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b5780 0x7ff7c4146b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40097a0 tx=0x7ff7b402a060 comp rx=0 tx=0).stop 2024-04-25T15:20:18.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.331+0000 7ff7cc13c640 1 -- 172.21.15.155:0/3865467470 shutdown_connections 2024-04-25T15:20:18.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.331+0000 7ff7cc13c640 1 --2- 172.21.15.155:0/3865467470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c40b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.331+0000 7ff7cc13c640 1 --2- 172.21.15.155:0/3865467470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b5780 0x7ff7c4146b70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.331+0000 7ff7cc13c640 1 -- 172.21.15.155:0/3865467470 >> 172.21.15.155:0/3865467470 conn(0x7ff7c406d6d0 msgr2=0x7ff7c406dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.332+0000 7ff7cc13c640 1 -- 172.21.15.155:0/3865467470 shutdown_connections 2024-04-25T15:20:18.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.332+0000 7ff7cc13c640 1 -- 172.21.15.155:0/3865467470 wait complete. 2024-04-25T15:20:18.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.333+0000 7ff7cc13c640 1 Processor -- start 2024-04-25T15:20:18.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.333+0000 7ff7cc13c640 1 -- start start 2024-04-25T15:20:18.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7cc13c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7c40b5780 0x7ff7c41373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7cc13c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b68b0 0x7ff7c4134b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7cc13c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c4135060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7cc13c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c40b5d10 con 0x7ff7c40b5780 2024-04-25T15:20:18.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7cc13c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c40b5b90 con 0x7ff7c40b68b0 2024-04-25T15:20:18.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7cc13c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c40b6cc0 con 0x7ff7c41470b0 2024-04-25T15:20:18.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7c96d7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b68b0 0x7ff7c4134b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7ca6d9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c4135060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7c96d7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b68b0 0x7ff7c4134b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:32852/0 (socket says 172.21.15.155:32852) 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7c96d7640 1 -- 172.21.15.155:0/2274029186 learned_addr learned my addr 172.21.15.155:0/2274029186 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7c9ed8640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7c40b5780 0x7ff7c41373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7ca6d9640 1 -- 172.21.15.155:0/2274029186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b68b0 msgr2=0x7ff7c4134b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7ca6d9640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b68b0 0x7ff7c4134b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7ca6d9640 1 -- 172.21.15.155:0/2274029186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7c40b5780 msgr2=0x7ff7c41373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7ca6d9640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7c40b5780 0x7ff7c41373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7ca6d9640 1 -- 172.21.15.155:0/2274029186 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c4153120 con 0x7ff7c41470b0 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.334+0000 7ff7c96d7640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b68b0 0x7ff7c4134b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.335+0000 7ff7ca6d9640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c4135060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff7c406e800 tx=0x7ff7bc00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.335+0000 7ff7ba7fc640 1 -- 172.21.15.155:0/2274029186 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc003b70 con 0x7ff7c41470b0 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.335+0000 7ff7ba7fc640 1 -- 172.21.15.155:0/2274029186 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7bc003d10 con 0x7ff7c41470b0 2024-04-25T15:20:18.338 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.335+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c4138280 con 0x7ff7c41470b0 2024-04-25T15:20:18.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.335+0000 7ff7ba7fc640 1 -- 172.21.15.155:0/2274029186 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc005310 con 0x7ff7c41470b0 2024-04-25T15:20:18.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.335+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c41355a0 con 0x7ff7c41470b0 2024-04-25T15:20:18.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.335+0000 7ff7ba7fc640 1 -- 172.21.15.155:0/2274029186 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff7bc0054b0 con 0x7ff7c41470b0 2024-04-25T15:20:18.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.335+0000 7ff7ba7fc640 1 -- 172.21.15.155:0/2274029186 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff7bc012460 con 0x7ff7c41470b0 2024-04-25T15:20:18.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.336+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c40764e0 con 0x7ff7c41470b0 2024-04-25T15:20:18.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.338+0000 7ff7ba7fc640 1 -- 172.21.15.155:0/2274029186 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff7c4153120 con 0x7ff7c41470b0 2024-04-25T15:20:18.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.410+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3a03cc6c-497d-4b8d-a588-5522635c93c5", "id": 1} v 0) -- 0x7ff7c4143d80 con 0x7ff7c41470b0 2024-04-25T15:20:18.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.413+0000 7ff7ba7fc640 1 -- 172.21.15.155:0/2274029186 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3a03cc6c-497d-4b8d-a588-5522635c93c5", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff7bc00a640 con 0x7ff7c41470b0 2024-04-25T15:20:18.414 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-25T15:20:18.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 msgr2=0x7ff7c4135060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c4135060 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff7c406e800 tx=0x7ff7bc00cb90 comp rx=0 tx=0).stop 2024-04-25T15:20:18.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 shutdown_connections 2024-04-25T15:20:18.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7c41470b0 0x7ff7c4135060 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7c40b68b0 0x7ff7c4134b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 --2- 172.21.15.155:0/2274029186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7c40b5780 0x7ff7c41373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 >> 172.21.15.155:0/2274029186 conn(0x7ff7c406d6d0 msgr2=0x7ff7c4072f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 shutdown_connections 2024-04-25T15:20:18.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.414+0000 7ff7cc13c640 1 -- 172.21.15.155:0/2274029186 wait complete. 2024-04-25T15:20:18.426 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new c05e19af-430b-47e6-a8aa-5cae483ed041 2 2024-04-25T15:20:18.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.533+0000 7f88323f3640 1 Processor -- start 2024-04-25T15:20:18.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.533+0000 7f88323f3640 1 -- start start 2024-04-25T15:20:18.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.534+0000 7f88323f3640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f882c0bc430 0x7f882c146470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.534+0000 7f88323f3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0b7d80 0x7f882c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.534+0000 7f88323f3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f882c0b8190 0x7f882c072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f88323f3640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f882c149a60 con 0x7f882c0bc430 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f88323f3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f882c0b31d0 con 0x7f882c0b8190 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f88323f3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f882c149cb0 con 0x7f882c0b7d80 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f882b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0b7d80 0x7f882c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f8830990640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f882c0b8190 0x7f882c072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f882b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0b7d80 0x7f882c0b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37766/0 (socket says 172.21.15.155:37766) 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f8830990640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f882c0b8190 0x7f882c072520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:32866/0 (socket says 172.21.15.155:32866) 2024-04-25T15:20:18.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f8830990640 1 -- 172.21.15.155:0/390519575 learned_addr learned my addr 172.21.15.155:0/390519575 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f882bfff640 1 --2- 172.21.15.155:0/390519575 >> v2:172.21.15.33:3300/0 conn(0x7f882c0bc430 0x7f882c146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f8830990640 1 -- 172.21.15.155:0/390519575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0b7d80 msgr2=0x7f882c0b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:18.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f8830990640 1 --2- 172.21.15.155:0/390519575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0b7d80 0x7f882c0b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f8830990640 1 -- 172.21.15.155:0/390519575 >> v2:172.21.15.33:3300/0 conn(0x7f882c0bc430 msgr2=0x7f882c146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:18.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f8830990640 1 --2- 172.21.15.155:0/390519575 >> v2:172.21.15.33:3300/0 conn(0x7f882c0bc430 0x7f882c146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f8830990640 1 -- 172.21.15.155:0/390519575 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c149f90 con 0x7f882c0b8190 2024-04-25T15:20:18.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.535+0000 7f882b7fe640 1 --2- 172.21.15.155:0/390519575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0b7d80 0x7f882c0b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:18.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.536+0000 7f8830990640 1 --2- 172.21.15.155:0/390519575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b8190 0x7f882c072520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f882c0724b0 tx=0x7f882402a8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66d4073b38fef9c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.536+0000 7f882affd640 1 -- 172.21.15.155:0/390519575 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824037070 con 0x7f882c0b8190 2024-04-25T15:20:18.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.536+0000 7f882affd640 1 -- 172.21.15.155:0/390519575 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8824032680 con 0x7f882c0b8190 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.536+0000 7f882affd640 1 -- 172.21.15.155:0/390519575 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824032a50 con 0x7f882c0b8190 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 -- 172.21.15.155:0/390519575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b8190 msgr2=0x7f882c072520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 --2- 172.21.15.155:0/390519575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b8190 0x7f882c072520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f882c0724b0 tx=0x7f882402a8d0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 -- 172.21.15.155:0/390519575 shutdown_connections 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 --2- 172.21.15.155:0/390519575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b8190 0x7f882c072520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 --2- 172.21.15.155:0/390519575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0b7d80 0x7f882c0b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 --2- 172.21.15.155:0/390519575 >> v2:172.21.15.33:3300/0 conn(0x7f882c0bc430 0x7f882c146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 -- 172.21.15.155:0/390519575 >> 172.21.15.155:0/390519575 conn(0x7f882c06dd00 msgr2=0x7f882c0bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 -- 172.21.15.155:0/390519575 shutdown_connections 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.537+0000 7f88323f3640 1 -- 172.21.15.155:0/390519575 wait complete. 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.538+0000 7f88323f3640 1 Processor -- start 2024-04-25T15:20:18.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.538+0000 7f88323f3640 1 -- start start 2024-04-25T15:20:18.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.539+0000 7f88323f3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b7d80 0x7f882c1cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.539+0000 7f88323f3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c0b8190 0x7f882c1477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.539+0000 7f88323f3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0bc430 0x7f882c1388e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.539+0000 7f88323f3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f882c1469b0 con 0x7f882c0b8190 2024-04-25T15:20:18.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.539+0000 7f88323f3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f882c0bc840 con 0x7f882c0b7d80 2024-04-25T15:20:18.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.539+0000 7f88323f3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f882c146b30 con 0x7f882c0bc430 2024-04-25T15:20:18.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b7d80 0x7f882c1cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b7d80 0x7f882c1cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:32878/0 (socket says 172.21.15.155:32878) 2024-04-25T15:20:18.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f8830990640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0bc430 0x7f882c1388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 -- 172.21.15.155:0/2055705815 learned_addr learned my addr 172.21.15.155:0/2055705815 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882b7fe640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c0b8190 0x7f882c1477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 -- 172.21.15.155:0/2055705815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0bc430 msgr2=0x7f882c1388e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0bc430 0x7f882c1388e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 -- 172.21.15.155:0/2055705815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c0b8190 msgr2=0x7f882c1477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c0b8190 0x7f882c1477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 -- 172.21.15.155:0/2055705815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c147d20 con 0x7f882c0b7d80 2024-04-25T15:20:18.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f8830990640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0bc430 0x7f882c1388e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:18.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f882bfff640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b7d80 0x7f882c1cfa20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f882000e870 tx=0x7f882000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f8828ff9640 1 -- 172.21.15.155:0/2055705815 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820017070 con 0x7f882c0b7d80 2024-04-25T15:20:18.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f8828ff9640 1 -- 172.21.15.155:0/2055705815 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882000c940 con 0x7f882c0b7d80 2024-04-25T15:20:18.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c1d1110 con 0x7f882c0b7d80 2024-04-25T15:20:18.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f8828ff9640 1 -- 172.21.15.155:0/2055705815 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882000cd10 con 0x7f882c0b7d80 2024-04-25T15:20:18.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c147f30 con 0x7f882c0b7d80 2024-04-25T15:20:18.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f8828ff9640 1 -- 172.21.15.155:0/2055705815 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f882001a070 con 0x7f882c0b7d80 2024-04-25T15:20:18.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.540+0000 7f8828ff9640 1 -- 172.21.15.155:0/2055705815 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8820013470 con 0x7f882c0b7d80 2024-04-25T15:20:18.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.542+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882c0764e0 con 0x7f882c0b7d80 2024-04-25T15:20:18.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.544+0000 7f8828ff9640 1 -- 172.21.15.155:0/2055705815 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8820006020 con 0x7f882c0b7d80 2024-04-25T15:20:18.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.615+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c05e19af-430b-47e6-a8aa-5cae483ed041", "id": 2} v 0) -- 0x7f882c0b5280 con 0x7f882c0b7d80 2024-04-25T15:20:18.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.619+0000 7f8828ff9640 1 -- 172.21.15.155:0/2055705815 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c05e19af-430b-47e6-a8aa-5cae483ed041", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8820006480 con 0x7f882c0b7d80 2024-04-25T15:20:18.620 INFO:teuthology.orchestra.run.smithi155.stdout:2 2024-04-25T15:20:18.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b7d80 msgr2=0x7f882c1cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b7d80 0x7f882c1cfa20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f882000e870 tx=0x7f882000ed30 comp rx=0 tx=0).stop 2024-04-25T15:20:18.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 shutdown_connections 2024-04-25T15:20:18.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f882c0bc430 0x7f882c1388e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f882c0b8190 0x7f882c1477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 --2- 172.21.15.155:0/2055705815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f882c0b7d80 0x7f882c1cfa20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 >> 172.21.15.155:0/2055705815 conn(0x7f882c06dd00 msgr2=0x7f882c0b8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 shutdown_connections 2024-04-25T15:20:18.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.620+0000 7f88323f3640 1 -- 172.21.15.155:0/2055705815 wait complete. 2024-04-25T15:20:18.632 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 3d2383d8-b32f-4add-b0b3-fc1f294598e3 3 2024-04-25T15:20:18.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.739+0000 7f2160386640 1 Processor -- start 2024-04-25T15:20:18.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.739+0000 7f2160386640 1 -- start start 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f2160386640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21580b15e0 0x7f21580b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f2160386640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f215814ce40 0x7f21580b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f2160386640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21580b5af0 0x7f21580b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f2160386640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f21580b1150 con 0x7f21580b5af0 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f2160386640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f215814d250 con 0x7f21580b15e0 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f2160386640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f21580b7600 con 0x7f215814ce40 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f215d921640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f215814ce40 0x7f21580b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f215e122640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21580b15e0 0x7f21580b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f215d921640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f215814ce40 0x7f21580b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59926/0 (socket says 172.21.15.155:59926) 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.740+0000 7f215d921640 1 -- 172.21.15.155:0/1124339226 learned_addr learned my addr 172.21.15.155:0/1124339226 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.741+0000 7f215e923640 1 --2- 172.21.15.155:0/1124339226 >> v2:172.21.15.33:3300/0 conn(0x7f21580b5af0 0x7f21580b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.741+0000 7f215e122640 1 -- 172.21.15.155:0/1124339226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f215814ce40 msgr2=0x7f21580b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.741+0000 7f215e122640 1 --2- 172.21.15.155:0/1124339226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f215814ce40 0x7f21580b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.741+0000 7f215e122640 1 -- 172.21.15.155:0/1124339226 >> v2:172.21.15.33:3300/0 conn(0x7f21580b5af0 msgr2=0x7f21580b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.741+0000 7f215e122640 1 --2- 172.21.15.155:0/1124339226 >> v2:172.21.15.33:3300/0 conn(0x7f21580b5af0 0x7f21580b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.741+0000 7f215e122640 1 -- 172.21.15.155:0/1124339226 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21580b78e0 con 0x7f21580b15e0 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.741+0000 7f215d921640 1 --2- 172.21.15.155:0/1124339226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f215814ce40 0x7f21580b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.741+0000 7f215e122640 1 --2- 172.21.15.155:0/1124339226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21580b15e0 0x7f21580b85a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21580bc180 tx=0x7f214802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f33f9d295dd37625 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.742+0000 7f215d120640 1 -- 172.21.15.155:0/1124339226 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148037070 con 0x7f21580b15e0 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.742+0000 7f215d120640 1 -- 172.21.15.155:0/1124339226 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f214802add0 con 0x7f21580b15e0 2024-04-25T15:20:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.742+0000 7f215d120640 1 -- 172.21.15.155:0/1124339226 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148032660 con 0x7f21580b15e0 2024-04-25T15:20:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.742+0000 7f2160386640 1 -- 172.21.15.155:0/1124339226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21580b15e0 msgr2=0x7f21580b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.742+0000 7f2160386640 1 --2- 172.21.15.155:0/1124339226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21580b15e0 0x7f21580b85a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f21580bc180 tx=0x7f214802a080 comp rx=0 tx=0).stop 2024-04-25T15:20:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.743+0000 7f2160386640 1 -- 172.21.15.155:0/1124339226 shutdown_connections 2024-04-25T15:20:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.743+0000 7f2160386640 1 --2- 172.21.15.155:0/1124339226 >> v2:172.21.15.33:3300/0 conn(0x7f21580b5af0 0x7f21580b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.743+0000 7f2160386640 1 --2- 172.21.15.155:0/1124339226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f215814ce40 0x7f21580b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.743+0000 7f2160386640 1 --2- 172.21.15.155:0/1124339226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21580b15e0 0x7f21580b85a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.743+0000 7f2160386640 1 -- 172.21.15.155:0/1124339226 >> 172.21.15.155:0/1124339226 conn(0x7f21580bbcc0 msgr2=0x7f21580b7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.743+0000 7f2160386640 1 -- 172.21.15.155:0/1124339226 shutdown_connections 2024-04-25T15:20:18.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.743+0000 7f2160386640 1 -- 172.21.15.155:0/1124339226 wait complete. 2024-04-25T15:20:18.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.744+0000 7f2160386640 1 Processor -- start 2024-04-25T15:20:18.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.744+0000 7f2160386640 1 -- start start 2024-04-25T15:20:18.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f2160386640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21580b15e0 0x7f21580732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f2160386640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21580b5af0 0x7f21581df450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f2160386640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215814ce40 0x7f2158142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f2160386640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f21580b6440 con 0x7f21580b15e0 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f2160386640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f21580b0cf0 con 0x7f215814ce40 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f2160386640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f21580b65c0 con 0x7f21580b5af0 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215e923640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215814ce40 0x7f2158142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215d921640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21580b5af0 0x7f21581df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215e923640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215814ce40 0x7f2158142650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50048/0 (socket says 172.21.15.155:50048) 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215e923640 1 -- 172.21.15.155:0/682462534 learned_addr learned my addr 172.21.15.155:0/682462534 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215e122640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21580b15e0 0x7f21580732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215d921640 1 -- 172.21.15.155:0/682462534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215814ce40 msgr2=0x7f2158142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215d921640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215814ce40 0x7f2158142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215d921640 1 -- 172.21.15.155:0/682462534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21580b15e0 msgr2=0x7f21580732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215d921640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21580b15e0 0x7f21580732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.745+0000 7f215d921640 1 -- 172.21.15.155:0/682462534 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21581df990 con 0x7f21580b5af0 2024-04-25T15:20:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f215e923640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215814ce40 0x7f2158142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f215d921640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21580b5af0 0x7f21581df450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f215400e860 tx=0x7f215400ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f214effd640 1 -- 172.21.15.155:0/682462534 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154004030 con 0x7f21580b5af0 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f214effd640 1 -- 172.21.15.155:0/682462534 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21540041d0 con 0x7f21580b5af0 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215814a9e0 con 0x7f21580b5af0 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f214effd640 1 -- 172.21.15.155:0/682462534 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215400c940 con 0x7f21580b5af0 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21580b2af0 con 0x7f21580b5af0 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f214effd640 1 -- 172.21.15.155:0/682462534 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2154005990 con 0x7f21580b5af0 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.746+0000 7f214effd640 1 -- 172.21.15.155:0/682462534 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f2154003c00 con 0x7f21580b5af0 2024-04-25T15:20:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.747+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21580764e0 con 0x7f21580b5af0 2024-04-25T15:20:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.749+0000 7f214effd640 1 -- 172.21.15.155:0/682462534 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2154017020 con 0x7f21580b5af0 2024-04-25T15:20:18.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.821+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3d2383d8-b32f-4add-b0b3-fc1f294598e3", "id": 3} v 0) -- 0x7f21581454d0 con 0x7f21580b5af0 2024-04-25T15:20:18.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.827+0000 7f214effd640 1 -- 172.21.15.155:0/682462534 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d2383d8-b32f-4add-b0b3-fc1f294598e3", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f21540093b0 con 0x7f21580b5af0 2024-04-25T15:20:18.829 INFO:teuthology.orchestra.run.smithi155.stdout:3 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.828+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21580b5af0 msgr2=0x7f21581df450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.828+0000 7f2160386640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21580b5af0 0x7f21581df450 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f215400e860 tx=0x7f215400ed20 comp rx=0 tx=0).stop 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.828+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 shutdown_connections 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.828+0000 7f2160386640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f215814ce40 0x7f2158142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.828+0000 7f2160386640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21580b5af0 0x7f21581df450 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.828+0000 7f2160386640 1 --2- 172.21.15.155:0/682462534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21580b15e0 0x7f21580732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.828+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 >> 172.21.15.155:0/682462534 conn(0x7f21580bbcc0 msgr2=0x7f21580ba0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.828+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 shutdown_connections 2024-04-25T15:20:18.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.829+0000 7f2160386640 1 -- 172.21.15.155:0/682462534 wait complete. 2024-04-25T15:20:18.841 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 89bdfcc2-bb8a-43db-8cc7-530b59758f0a 4 2024-04-25T15:20:18.868 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:18.867+0000 7ff14e61b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:20:18.886 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:18.885+0000 7fae5b42e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T15:20:18.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.947+0000 7fcfafa30640 1 Processor -- start 2024-04-25T15:20:18.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.947+0000 7fcfafa30640 1 -- start start 2024-04-25T15:20:18.949 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.948+0000 7fcfafa30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80b4f60 0x7fcfa8141a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.948+0000 7fcfafa30640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa80b7100 con 0x7fcfa8141660 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.948+0000 7fcfafa30640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa8074410 con 0x7fcfa8074000 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.948+0000 7fcfafa30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa80b7470 con 0x7fcfa80b4f60 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.948+0000 7fcfadfcd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80b4f60 0x7fcfa8141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.948+0000 7fcfad7cc640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fcfa8074000 0x7fcfa80b3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:51604/0 (socket says 172.21.15.155:51604) 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.948+0000 7fcfad7cc640 1 -- 172.21.15.155:0/1326861626 learned_addr learned my addr 172.21.15.155:0/1326861626 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.948+0000 7fcf9ffff640 1 -- 172.21.15.155:0/1326861626 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830091267 0 0) 0x7fcfa8074410 con 0x7fcfa8074000 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.949+0000 7fcfadfcd640 1 -- 172.21.15.155:0/1326861626 >> v1:172.21.15.155:6789/0 conn(0x7fcfa8074000 legacy=0x7fcfa80b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.949+0000 7fcfadfcd640 1 -- 172.21.15.155:0/1326861626 >> v1:172.21.15.33:6789/0 conn(0x7fcfa8141660 legacy=0x7fcfa80b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.950 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.949+0000 7fcfadfcd640 1 -- 172.21.15.155:0/1326861626 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa80b1fc0 con 0x7fcfa80b4f60 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.949+0000 7fcfadfcd640 1 --2- 172.21.15.155:0/1326861626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80b4f60 0x7fcfa8141a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009dc0 tx=0x7fcfa002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f1478ab15c4bae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.949+0000 7fcf9ffff640 1 -- 172.21.15.155:0/1326861626 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0007740 con 0x7fcfa80b4f60 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.949+0000 7fcf9ffff640 1 -- 172.21.15.155:0/1326861626 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa00078e0 con 0x7fcfa80b4f60 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.949+0000 7fcf9ffff640 1 -- 172.21.15.155:0/1326861626 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0007cb0 con 0x7fcfa80b4f60 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.950+0000 7fcfafa30640 1 -- 172.21.15.155:0/1326861626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80b4f60 msgr2=0x7fcfa8141a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.950+0000 7fcfafa30640 1 --2- 172.21.15.155:0/1326861626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80b4f60 0x7fcfa8141a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009dc0 tx=0x7fcfa002a6d0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.950+0000 7fcfafa30640 1 -- 172.21.15.155:0/1326861626 shutdown_connections 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.950+0000 7fcfafa30640 1 --2- 172.21.15.155:0/1326861626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa80b4f60 0x7fcfa8141a70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.950+0000 7fcfafa30640 1 -- 172.21.15.155:0/1326861626 >> 172.21.15.155:0/1326861626 conn(0x7fcfa80bb2e0 msgr2=0x7fcfa80bb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.950+0000 7fcfafa30640 1 -- 172.21.15.155:0/1326861626 shutdown_connections 2024-04-25T15:20:18.952 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.950+0000 7fcfafa30640 1 -- 172.21.15.155:0/1326861626 wait complete. 2024-04-25T15:20:18.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.953+0000 7fcfafa30640 1 Processor -- start 2024-04-25T15:20:18.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.953+0000 7fcfafa30640 1 -- start start 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfafa30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8074000 0x7fcfa8132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfafa30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa80b4f60 0x7fcfa8140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfafa30640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa8141660 0x7fcfa8140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfafa30640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa8153340 con 0x7fcfa80b4f60 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfafa30640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa81531c0 con 0x7fcfa8141660 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfafa30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa81534c0 con 0x7fcfa8074000 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfad7cc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8074000 0x7fcfa8132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfad7cc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8074000 0x7fcfa8132610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59966/0 (socket says 172.21.15.155:59966) 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfad7cc640 1 -- 172.21.15.155:0/333159997 learned_addr learned my addr 172.21.15.155:0/333159997 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:18.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.954+0000 7fcfadfcd640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa8141660 0x7fcfa8140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfacfcb640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa80b4f60 0x7fcfa8140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfadfcd640 1 -- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8074000 msgr2=0x7fcfa8132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfadfcd640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8074000 0x7fcfa8132610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfadfcd640 1 -- 172.21.15.155:0/333159997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa80b4f60 msgr2=0x7fcfa8140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfadfcd640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa80b4f60 0x7fcfa8140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfadfcd640 1 -- 172.21.15.155:0/333159997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa81446d0 con 0x7fcfa8141660 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfad7cc640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8074000 0x7fcfa8132610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfadfcd640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa8141660 0x7fcfa8140c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8070e20 tx=0x7fcfa0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcf9dffb640 1 -- 172.21.15.155:0/333159997 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa003f070 con 0x7fcfa8141660 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcf9dffb640 1 -- 172.21.15.155:0/333159997 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa0031bc0 con 0x7fcfa8141660 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcf9dffb640 1 -- 172.21.15.155:0/333159997 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0044460 con 0x7fcfa8141660 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa81e0f30 con 0x7fcfa8141660 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.955+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa81e1a10 con 0x7fcfa8141660 2024-04-25T15:20:18.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.956+0000 7fcf9dffb640 1 -- 172.21.15.155:0/333159997 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcfa0044600 con 0x7fcfa8141660 2024-04-25T15:20:18.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.956+0000 7fcf9dffb640 1 -- 172.21.15.155:0/333159997 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fcfa004d3f0 con 0x7fcfa8141660 2024-04-25T15:20:18.959 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:18.959+0000 7ff14e61b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:20:18.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.957+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa8144950 con 0x7fcfa8141660 2024-04-25T15:20:18.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:18.959+0000 7fcf9dffb640 1 -- 172.21.15.155:0/333159997 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcfa0052080 con 0x7fcfa8141660 2024-04-25T15:20:18.981 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:18.980+0000 7fae5b42e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T15:20:19.004 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:19.003+0000 7ff14e61b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:20:19.026 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:19.025+0000 7fae5b42e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T15:20:19.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.031+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89bdfcc2-bb8a-43db-8cc7-530b59758f0a", "id": 4} v 0) -- 0x7fcfa80764e0 con 0x7fcfa8141660 2024-04-25T15:20:19.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.037+0000 7fcf9dffb640 1 -- 172.21.15.155:0/333159997 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89bdfcc2-bb8a-43db-8cc7-530b59758f0a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fcfa0007840 con 0x7fcfa8141660 2024-04-25T15:20:19.038 INFO:teuthology.orchestra.run.smithi155.stdout:4 2024-04-25T15:20:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa8141660 msgr2=0x7fcfa8140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa8141660 0x7fcfa8140c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8070e20 tx=0x7fcfa0004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 shutdown_connections 2024-04-25T15:20:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfa8141660 0x7fcfa8140c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa80b4f60 0x7fcfa8140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 --2- 172.21.15.155:0/333159997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcfa8074000 0x7fcfa8132610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 >> 172.21.15.155:0/333159997 conn(0x7fcfa80bb2e0 msgr2=0x7fcfa8075ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 shutdown_connections 2024-04-25T15:20:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.038+0000 7fcfafa30640 1 -- 172.21.15.155:0/333159997 wait complete. 2024-04-25T15:20:19.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 243b8252-3532-4e5b-9fa1-cec012000b0a 5 2024-04-25T15:20:19.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.155+0000 7f0e58384640 1 Processor -- start 2024-04-25T15:20:19.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.155+0000 7f0e58384640 1 -- start start 2024-04-25T15:20:19.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.156+0000 7f0e58384640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e500b15e0 0x7f0e500b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.156+0000 7f0e58384640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5014d250 con 0x7f0e5014ce40 2024-04-25T15:20:19.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.156+0000 7f0e58384640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e500b7600 con 0x7f0e501432a0 2024-04-25T15:20:19.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.156+0000 7f0e58384640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f0e500b1150 con 0x7f0e500b15e0 2024-04-25T15:20:19.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.156+0000 7f0e56921640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0e501432a0 0x7f0e501436b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:51608/0 (socket says 172.21.15.155:51608) 2024-04-25T15:20:19.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.156+0000 7f0e56921640 1 -- 172.21.15.155:0/1013414671 learned_addr learned my addr 172.21.15.155:0/1013414671 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T15:20:19.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.156+0000 7f0e56120640 1 --2- 172.21.15.155:0/1013414671 >> v2:172.21.15.33:3300/0 conn(0x7f0e500b15e0 0x7f0e500b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.157+0000 7f0e5511e640 1 -- 172.21.15.155:0/1013414671 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152934644 0 0) 0x7f0e500b7600 con 0x7f0e501432a0 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.157+0000 7f0e5511e640 1 -- 172.21.15.155:0/1013414671 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e3c003520 con 0x7f0e501432a0 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.157+0000 7f0e5511e640 1 -- 172.21.15.155:0/1013414671 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444435891 0 0) 0x7f0e5014d250 con 0x7f0e5014ce40 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.157+0000 7f0e5511e640 1 -- 172.21.15.155:0/1013414671 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e500b7600 con 0x7f0e5014ce40 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.157+0000 7f0e5511e640 1 -- 172.21.15.155:0/1013414671 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3285485957 0 0) 0x7f0e3c003520 con 0x7f0e501432a0 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.157+0000 7f0e56120640 1 -- 172.21.15.155:0/1013414671 >> v1:172.21.15.155:6789/0 conn(0x7f0e501432a0 legacy=0x7f0e501436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.157+0000 7f0e56120640 1 -- 172.21.15.155:0/1013414671 >> v1:172.21.15.33:6789/0 conn(0x7f0e5014ce40 legacy=0x7f0e500b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.157+0000 7f0e56120640 1 -- 172.21.15.155:0/1013414671 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e500b78e0 con 0x7f0e500b15e0 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.158+0000 7f0e56120640 1 --2- 172.21.15.155:0/1013414671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500b15e0 0x7f0e500b85a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009720 tx=0x7f0e4002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e241bce50ab67d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.158+0000 7f0e5511e640 1 -- 172.21.15.155:0/1013414671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e40037070 con 0x7f0e500b15e0 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.158+0000 7f0e5511e640 1 -- 172.21.15.155:0/1013414671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4002abe0 con 0x7f0e500b15e0 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.158+0000 7f0e5511e640 1 -- 172.21.15.155:0/1013414671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e480019f0 con 0x7f0e500b15e0 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.159+0000 7f0e58384640 1 -- 172.21.15.155:0/1013414671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500b15e0 msgr2=0x7f0e500b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.159+0000 7f0e58384640 1 --2- 172.21.15.155:0/1013414671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500b15e0 0x7f0e500b85a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e40009720 tx=0x7f0e4002a0d0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.159+0000 7f0e58384640 1 -- 172.21.15.155:0/1013414671 shutdown_connections 2024-04-25T15:20:19.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.159+0000 7f0e58384640 1 --2- 172.21.15.155:0/1013414671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500b15e0 0x7f0e500b85a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.159+0000 7f0e58384640 1 -- 172.21.15.155:0/1013414671 >> 172.21.15.155:0/1013414671 conn(0x7f0e500bbcc0 msgr2=0x7f0e500b7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.159+0000 7f0e58384640 1 -- 172.21.15.155:0/1013414671 shutdown_connections 2024-04-25T15:20:19.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.159+0000 7f0e58384640 1 -- 172.21.15.155:0/1013414671 wait complete. 2024-04-25T15:20:19.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.160+0000 7f0e58384640 1 Processor -- start 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.160+0000 7f0e58384640 1 -- start start 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e58384640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e500b15e0 0x7f0e500728f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e58384640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e501432a0 0x7f0e501e30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e58384640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5014ce40 0x7f0e50141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e58384640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0e50143f40 con 0x7f0e5014ce40 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e58384640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e50143dc0 con 0x7f0e501432a0 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e58384640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e501440c0 con 0x7f0e500b15e0 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e5591f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e501432a0 0x7f0e501e30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e56120640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e500b15e0 0x7f0e500728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e5591f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e501432a0 0x7f0e501e30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50068/0 (socket says 172.21.15.155:50068) 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e56120640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e500b15e0 0x7f0e500728f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59970/0 (socket says 172.21.15.155:59970) 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e5591f640 1 -- 172.21.15.155:0/3500664221 learned_addr learned my addr 172.21.15.155:0/3500664221 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:19.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.161+0000 7f0e56921640 1 --2- 172.21.15.155:0/3500664221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5014ce40 0x7f0e50141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e5591f640 1 -- 172.21.15.155:0/3500664221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e500b15e0 msgr2=0x7f0e500728f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e5591f640 1 --2- 172.21.15.155:0/3500664221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e500b15e0 0x7f0e500728f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e5591f640 1 -- 172.21.15.155:0/3500664221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5014ce40 msgr2=0x7f0e50141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e5591f640 1 --2- 172.21.15.155:0/3500664221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5014ce40 0x7f0e50141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e5591f640 1 -- 172.21.15.155:0/3500664221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e501e3620 con 0x7f0e501432a0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e5591f640 1 --2- 172.21.15.155:0/3500664221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e501432a0 0x7f0e501e30e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c3c0 tx=0x7f0e4c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e46ffd640 1 -- 172.21.15.155:0/3500664221 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c017070 con 0x7f0e501432a0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e46ffd640 1 -- 172.21.15.155:0/3500664221 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c0052f0 con 0x7f0e501432a0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e46ffd640 1 -- 172.21.15.155:0/3500664221 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003830 con 0x7f0e501432a0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e50146ef0 con 0x7f0e501432a0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e501e3830 con 0x7f0e501432a0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e46ffd640 1 -- 172.21.15.155:0/3500664221 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e4c01a070 con 0x7f0e501432a0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.162+0000 7f0e46ffd640 1 -- 172.21.15.155:0/3500664221 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0e4c011d10 con 0x7f0e501432a0 2024-04-25T15:20:19.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.163+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e500b1e70 con 0x7f0e501432a0 2024-04-25T15:20:19.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.165+0000 7f0e46ffd640 1 -- 172.21.15.155:0/3500664221 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0e500b1e70 con 0x7f0e501432a0 2024-04-25T15:20:19.176 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:19.176+0000 7ff14e61b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:20:19.210 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:19.209+0000 7fae5b42e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T15:20:19.235 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:19.235+0000 7ff14e61b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:20:19.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.245+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "243b8252-3532-4e5b-9fa1-cec012000b0a", "id": 5} v 0) -- 0x7f0e500b2530 con 0x7f0e501432a0 2024-04-25T15:20:19.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.249+0000 7f0e46ffd640 1 -- 172.21.15.155:0/3500664221 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "243b8252-3532-4e5b-9fa1-cec012000b0a", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0e500b2530 con 0x7f0e501432a0 2024-04-25T15:20:19.250 INFO:teuthology.orchestra.run.smithi155.stdout:5 2024-04-25T15:20:19.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e501432a0 msgr2=0x7f0e501e30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 --2- 172.21.15.155:0/3500664221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e501432a0 0x7f0e501e30e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c3c0 tx=0x7f0e4c00c880 comp rx=0 tx=0).stop 2024-04-25T15:20:19.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 shutdown_connections 2024-04-25T15:20:19.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 --2- 172.21.15.155:0/3500664221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5014ce40 0x7f0e50141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 --2- 172.21.15.155:0/3500664221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e501432a0 0x7f0e501e30e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 --2- 172.21.15.155:0/3500664221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e500b15e0 0x7f0e500728f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 >> 172.21.15.155:0/3500664221 conn(0x7f0e500bbcc0 msgr2=0x7f0e50142960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 shutdown_connections 2024-04-25T15:20:19.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.250+0000 7f0e58384640 1 -- 172.21.15.155:0/3500664221 wait complete. 2024-04-25T15:20:19.259 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:19.258+0000 7fae5b42e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T15:20:19.262 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 3b26a204-fd86-4c54-a4a0-bc6bf77ca794 6 2024-04-25T15:20:19.291 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:19.290+0000 7ff14e61b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:20:19.318 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:19.315+0000 7fae5b42e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T15:20:19.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.367+0000 7fb494a96640 1 Processor -- start 2024-04-25T15:20:19.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.367+0000 7fb494a96640 1 -- start start 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb494a96640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb4900b15e0 0x7fb4900b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb494a96640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb4901432a0 0x7fb4901436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb494a96640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb49014d250 con 0x7fb49014ce40 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb494a96640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fb4900b1150 con 0x7fb4901432a0 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb494a96640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb4900b7600 con 0x7fb4900b15e0 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48e59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb4900b15e0 0x7fb4900b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48e59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb4900b15e0 0x7fb4900b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50072/0 (socket says 172.21.15.155:50072) 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48e59c640 1 -- 172.21.15.155:0/605684572 learned_addr learned my addr 172.21.15.155:0/605684572 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:19.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48ed9d640 1 --2- 172.21.15.155:0/605684572 >> v2:172.21.15.33:3300/0 conn(0x7fb4901432a0 0x7fb4901436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48e59c640 1 -- 172.21.15.155:0/605684572 >> v2:172.21.15.33:3300/0 conn(0x7fb4901432a0 msgr2=0x7fb4901436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48e59c640 1 --2- 172.21.15.155:0/605684572 >> v2:172.21.15.33:3300/0 conn(0x7fb4901432a0 0x7fb4901436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48e59c640 1 -- 172.21.15.155:0/605684572 >> v1:172.21.15.33:6789/0 conn(0x7fb49014ce40 legacy=0x7fb4900b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48e59c640 1 -- 172.21.15.155:0/605684572 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4900b78e0 con 0x7fb4900b15e0 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.369+0000 7fb48ed9d640 1 --2- 172.21.15.155:0/605684572 >> v2:172.21.15.33:3300/0 conn(0x7fb4901432a0 0x7fb4901436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.370+0000 7fb48e59c640 1 --2- 172.21.15.155:0/605684572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4900b15e0 0x7fb4900b85a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4900bc180 tx=0x7fb48402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=737c0f845dcf0881 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.370+0000 7fb48d59a640 1 -- 172.21.15.155:0/605684572 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484037070 con 0x7fb4900b15e0 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.370+0000 7fb48d59a640 1 -- 172.21.15.155:0/605684572 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb484032440 con 0x7fb4900b15e0 2024-04-25T15:20:19.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.370+0000 7fb48d59a640 1 -- 172.21.15.155:0/605684572 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484032810 con 0x7fb4900b15e0 2024-04-25T15:20:19.373 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.371+0000 7fb494a96640 1 -- 172.21.15.155:0/605684572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4900b15e0 msgr2=0x7fb4900b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.371+0000 7fb494a96640 1 --2- 172.21.15.155:0/605684572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4900b15e0 0x7fb4900b85a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb4900bc180 tx=0x7fb48402a1e0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.371+0000 7fb494a96640 1 -- 172.21.15.155:0/605684572 shutdown_connections 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.371+0000 7fb494a96640 1 --2- 172.21.15.155:0/605684572 >> v2:172.21.15.33:3300/0 conn(0x7fb4901432a0 0x7fb4901436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.371+0000 7fb494a96640 1 --2- 172.21.15.155:0/605684572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4900b15e0 0x7fb4900b85a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.371+0000 7fb494a96640 1 -- 172.21.15.155:0/605684572 >> 172.21.15.155:0/605684572 conn(0x7fb4900bbcc0 msgr2=0x7fb4900b7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.371+0000 7fb494a96640 1 -- 172.21.15.155:0/605684572 shutdown_connections 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.371+0000 7fb494a96640 1 -- 172.21.15.155:0/605684572 wait complete. 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.372+0000 7fb494a96640 1 Processor -- start 2024-04-25T15:20:19.374 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.373+0000 7fb494a96640 1 -- start start 2024-04-25T15:20:19.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.373+0000 7fb494a96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4900b15e0 0x7fb49014c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.373+0000 7fb494a96640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4901432a0 0x7fb4901e28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb494a96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49014ce40 0x7fb490071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb494a96640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb490143d70 con 0x7fb4901432a0 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb494a96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb490143bf0 con 0x7fb49014ce40 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb494a96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb490143ef0 con 0x7fb4900b15e0 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4900b15e0 0x7fb49014c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4900b15e0 0x7fb49014c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59976/0 (socket says 172.21.15.155:59976) 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 -- 172.21.15.155:0/3572146120 learned_addr learned my addr 172.21.15.155:0/3572146120 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49014ce40 0x7fb490071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48dd9b640 1 --2- 172.21.15.155:0/3572146120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4901432a0 0x7fb4901e28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 -- 172.21.15.155:0/3572146120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49014ce40 msgr2=0x7fb490071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 --2- 172.21.15.155:0/3572146120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49014ce40 0x7fb490071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 -- 172.21.15.155:0/3572146120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4901432a0 msgr2=0x7fb4901e28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 --2- 172.21.15.155:0/3572146120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4901432a0 0x7fb4901e28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 -- 172.21.15.155:0/3572146120 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4900b4b10 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb48e59c640 1 --2- 172.21.15.155:0/3572146120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4900b15e0 0x7fb49014c420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb48402a220 tx=0x7fb4840046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb47effd640 1 -- 172.21.15.155:0/3572146120 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484041020 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb47effd640 1 -- 172.21.15.155:0/3572146120 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4840306c0 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4900a1450 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb47effd640 1 -- 172.21.15.155:0/3572146120 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484037040 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.374+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49014a9f0 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.375+0000 7fb47effd640 1 -- 172.21.15.155:0/3572146120 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb484044020 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.375+0000 7fb47effd640 1 -- 172.21.15.155:0/3572146120 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb48403dc90 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.375+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4900764e0 con 0x7fb4900b15e0 2024-04-25T15:20:19.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.378+0000 7fb47effd640 1 -- 172.21.15.155:0/3572146120 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb48404b030 con 0x7fb4900b15e0 2024-04-25T15:20:19.408 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:19.408+0000 7ff14e61b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:20:19.433 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:19.432+0000 7fae5b42e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T15:20:19.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.449+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3b26a204-fd86-4c54-a4a0-bc6bf77ca794", "id": 6} v 0) -- 0x7fb490072f30 con 0x7fb4900b15e0 2024-04-25T15:20:19.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.454+0000 7fb47effd640 1 -- 172.21.15.155:0/3572146120 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b26a204-fd86-4c54-a4a0-bc6bf77ca794", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb48403d420 con 0x7fb4900b15e0 2024-04-25T15:20:19.455 INFO:teuthology.orchestra.run.smithi155.stdout:6 2024-04-25T15:20:19.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4900b15e0 msgr2=0x7fb49014c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 --2- 172.21.15.155:0/3572146120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4900b15e0 0x7fb49014c420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb48402a220 tx=0x7fb4840046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 shutdown_connections 2024-04-25T15:20:19.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 --2- 172.21.15.155:0/3572146120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb49014ce40 0x7fb490071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 --2- 172.21.15.155:0/3572146120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4901432a0 0x7fb4901e28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 --2- 172.21.15.155:0/3572146120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4900b15e0 0x7fb49014c420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 >> 172.21.15.155:0/3572146120 conn(0x7fb4900bbcc0 msgr2=0x7fb490147840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 shutdown_connections 2024-04-25T15:20:19.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.455+0000 7fb494a96640 1 -- 172.21.15.155:0/3572146120 wait complete. 2024-04-25T15:20:19.467 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 9cad4aaa-b466-4003-a125-8eb3113d995a 7 2024-04-25T15:20:19.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.573+0000 7fdfefbb2640 1 Processor -- start 2024-04-25T15:20:19.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.573+0000 7fdfefbb2640 1 -- start start 2024-04-25T15:20:19.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.574+0000 7fdfefbb2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdfe80715f0 0x7fdfe8143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.574+0000 7fdfefbb2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe814cd30 0x7fdfe81540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.574+0000 7fdfefbb2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe8072100 con 0x7fdfe80710a0 2024-04-25T15:20:19.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.574+0000 7fdfefbb2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe806f150 con 0x7fdfe80715f0 2024-04-25T15:20:19.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.574+0000 7fdfefbb2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe806ede0 con 0x7fdfe814cd30 2024-04-25T15:20:19.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfee14f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe814cd30 0x7fdfe81540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfed94e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdfe80715f0 0x7fdfe8143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfed94e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdfe80715f0 0x7fdfe8143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50098/0 (socket says 172.21.15.155:50098) 2024-04-25T15:20:19.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfee14f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe814cd30 0x7fdfe81540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59986/0 (socket says 172.21.15.155:59986) 2024-04-25T15:20:19.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfed94e640 1 -- 172.21.15.155:0/3643325960 learned_addr learned my addr 172.21.15.155:0/3643325960 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:19.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfed14d640 1 --1- 172.21.15.155:0/3643325960 >> v1:172.21.15.155:6789/0 conn(0x7fdfe80710a0 0x7fdfe806d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:51616/0 (socket says 172.21.15.155:51616) 2024-04-25T15:20:19.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfec94c640 1 -- 172.21.15.155:0/3643325960 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161907156 0 0) 0x7fdfe8072100 con 0x7fdfe80710a0 2024-04-25T15:20:19.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfec94c640 1 -- 172.21.15.155:0/3643325960 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd4003520 con 0x7fdfe80710a0 2024-04-25T15:20:19.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfed94e640 1 -- 172.21.15.155:0/3643325960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe814cd30 msgr2=0x7fdfe81540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:19.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfed94e640 1 --2- 172.21.15.155:0/3643325960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe814cd30 0x7fdfe81540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfed94e640 1 -- 172.21.15.155:0/3643325960 >> v1:172.21.15.155:6789/0 conn(0x7fdfe80710a0 legacy=0x7fdfe806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfed94e640 1 -- 172.21.15.155:0/3643325960 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe8143eb0 con 0x7fdfe80715f0 2024-04-25T15:20:19.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.575+0000 7fdfee14f640 1 --2- 172.21.15.155:0/3643325960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe814cd30 0x7fdfe81540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:19.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.576+0000 7fdfed94e640 1 --2- 172.21.15.155:0/3643325960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe80715f0 0x7fdfe8143970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009870 tx=0x7fdfe402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b410bafa1c86c028 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:19.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.576+0000 7fdfec94c640 1 -- 172.21.15.155:0/3643325960 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4037070 con 0x7fdfe80715f0 2024-04-25T15:20:19.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.576+0000 7fdfec94c640 1 -- 172.21.15.155:0/3643325960 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe4032440 con 0x7fdfe80715f0 2024-04-25T15:20:19.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.576+0000 7fdfec94c640 1 -- 172.21.15.155:0/3643325960 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4032810 con 0x7fdfe80715f0 2024-04-25T15:20:19.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.577+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3643325960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe80715f0 msgr2=0x7fdfe8143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.577+0000 7fdfefbb2640 1 --2- 172.21.15.155:0/3643325960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe80715f0 0x7fdfe8143970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009870 tx=0x7fdfe402a180 comp rx=0 tx=0).stop 2024-04-25T15:20:19.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.577+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3643325960 shutdown_connections 2024-04-25T15:20:19.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.577+0000 7fdfefbb2640 1 --2- 172.21.15.155:0/3643325960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe814cd30 0x7fdfe81540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.577+0000 7fdfefbb2640 1 --2- 172.21.15.155:0/3643325960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe80715f0 0x7fdfe8143970 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.577+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3643325960 >> 172.21.15.155:0/3643325960 conn(0x7fdfe80bcba0 msgr2=0x7fdfe80bcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.577+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3643325960 shutdown_connections 2024-04-25T15:20:19.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.577+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3643325960 wait complete. 2024-04-25T15:20:19.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.578+0000 7fdfefbb2640 1 Processor -- start 2024-04-25T15:20:19.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.578+0000 7fdfefbb2640 1 -- start start 2024-04-25T15:20:19.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfefbb2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe80710a0 0x7fdfe8149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfefbb2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfe80715f0 0x7fdfe81df830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfefbb2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe814cd30 0x7fdfe81430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfefbb2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe806f760 con 0x7fdfe80715f0 2024-04-25T15:20:19.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfefbb2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe806f5e0 con 0x7fdfe814cd30 2024-04-25T15:20:19.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfefbb2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe814d140 con 0x7fdfe80710a0 2024-04-25T15:20:19.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfed94e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe80710a0 0x7fdfe8149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfed94e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe80710a0 0x7fdfe8149c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:59994/0 (socket says 172.21.15.155:59994) 2024-04-25T15:20:19.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfed94e640 1 -- 172.21.15.155:0/3865609890 learned_addr learned my addr 172.21.15.155:0/3865609890 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T15:20:19.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfee14f640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe814cd30 0x7fdfe81430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.579+0000 7fdfed14d640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfe80715f0 0x7fdfe81df830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfed94e640 1 -- 172.21.15.155:0/3865609890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe814cd30 msgr2=0x7fdfe81430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfed94e640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe814cd30 0x7fdfe81430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfed94e640 1 -- 172.21.15.155:0/3865609890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfe80715f0 msgr2=0x7fdfe81df830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfed94e640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfe80715f0 0x7fdfe81df830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfed94e640 1 -- 172.21.15.155:0/3865609890 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe81dfd70 con 0x7fdfe80710a0 2024-04-25T15:20:19.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfed14d640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfe80715f0 0x7fdfe81df830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:19.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfed94e640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe80710a0 0x7fdfe8149c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009870 tx=0x7fdfe40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:19.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfda7fc640 1 -- 172.21.15.155:0/3865609890 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4041020 con 0x7fdfe80710a0 2024-04-25T15:20:19.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfda7fc640 1 -- 172.21.15.155:0/3865609890 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe403d620 con 0x7fdfe80710a0 2024-04-25T15:20:19.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfda7fc640 1 -- 172.21.15.155:0/3865609890 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4037040 con 0x7fdfe80710a0 2024-04-25T15:20:19.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe8149630 con 0x7fdfe80710a0 2024-04-25T15:20:19.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe814a4f0 con 0x7fdfe80710a0 2024-04-25T15:20:19.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfda7fc640 1 -- 172.21.15.155:0/3865609890 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdfe4044020 con 0x7fdfe80710a0 2024-04-25T15:20:19.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.580+0000 7fdfda7fc640 1 -- 172.21.15.155:0/3865609890 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fdfe4046bd0 con 0x7fdfe80710a0 2024-04-25T15:20:19.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.581+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe80764e0 con 0x7fdfe80710a0 2024-04-25T15:20:19.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.585+0000 7fdfda7fc640 1 -- 172.21.15.155:0/3865609890 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fdfe404b030 con 0x7fdfe80710a0 2024-04-25T15:20:19.657 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.656+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9cad4aaa-b466-4003-a125-8eb3113d995a", "id": 7} v 0) -- 0x7fdfe80bbec0 con 0x7fdfe80710a0 2024-04-25T15:20:19.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.664+0000 7fdfda7fc640 1 -- 172.21.15.155:0/3865609890 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9cad4aaa-b466-4003-a125-8eb3113d995a", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fdfe4046400 con 0x7fdfe80710a0 2024-04-25T15:20:19.666 INFO:teuthology.orchestra.run.smithi155.stdout:7 2024-04-25T15:20:19.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.665+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe80710a0 msgr2=0x7fdfe8149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.665+0000 7fdfefbb2640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe80710a0 0x7fdfe8149c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009870 tx=0x7fdfe40046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.665+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 shutdown_connections 2024-04-25T15:20:19.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.665+0000 7fdfefbb2640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfe814cd30 0x7fdfe81430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.665+0000 7fdfefbb2640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfe80715f0 0x7fdfe81df830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.665+0000 7fdfefbb2640 1 --2- 172.21.15.155:0/3865609890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfe80710a0 0x7fdfe8149c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.665+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 >> 172.21.15.155:0/3865609890 conn(0x7fdfe80bcba0 msgr2=0x7fdfe80b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.666+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 shutdown_connections 2024-04-25T15:20:19.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T15:20:19.666+0000 7fdfefbb2640 1 -- 172.21.15.155:0/3865609890 wait complete. 2024-04-25T15:20:19.677 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T15:20:19.678 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T15:20:19.680 INFO:tasks.ceph.osd.0:Started 2024-04-25T15:20:19.680 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T15:20:19.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T15:20:19.682 INFO:tasks.ceph.osd.1:Started 2024-04-25T15:20:19.682 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T15:20:19.682 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T15:20:19.684 INFO:tasks.ceph.osd.2:Started 2024-04-25T15:20:19.684 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T15:20:19.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T15:20:19.687 INFO:tasks.ceph.osd.3:Started 2024-04-25T15:20:19.687 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T15:20:19.687 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T15:20:19.689 INFO:tasks.ceph.osd.4:Started 2024-04-25T15:20:19.689 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T15:20:19.689 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T15:20:19.691 INFO:tasks.ceph.osd.5:Started 2024-04-25T15:20:19.692 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T15:20:19.692 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T15:20:19.694 INFO:tasks.ceph.osd.6:Started 2024-04-25T15:20:19.694 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T15:20:19.694 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T15:20:19.699 INFO:tasks.ceph.osd.7:Started 2024-04-25T15:20:19.700 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:19.850 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:19.850+0000 7ff14e61b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T15:20:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.852+0000 7f479ac49640 1 Processor -- start 2024-04-25T15:20:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.852+0000 7f479ac49640 1 -- start start 2024-04-25T15:20:19.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.853+0000 7f479ac49640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4794153000 0x7f4794155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.853+0000 7f479ac49640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4794149a90 con 0x7f4794149680 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f479ac49640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f479414cc70 con 0x7f479414d750 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f479ac49640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f479414a6b0 con 0x7f4794153000 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47989e5640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4794149680 0x7f4794149fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55930/0 (socket says 172.21.15.33:55930) 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47989e5640 1 -- 172.21.15.33:0/4264213284 learned_addr learned my addr 172.21.15.33:0/4264213284 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47991e6640 1 --2- 172.21.15.33:0/4264213284 >> v2:172.21.15.155:3300/0 conn(0x7f4794153000 0x7f4794155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47937fe640 1 -- 172.21.15.33:0/4264213284 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632450163 0 0) 0x7f4788001110 con 0x7f4794149680 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47937fe640 1 -- 172.21.15.33:0/4264213284 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4784003520 con 0x7f4794149680 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47991e6640 1 -- 172.21.15.33:0/4264213284 >> v1:172.21.15.155:6789/0 conn(0x7f479414d750 legacy=0x7f479406ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47991e6640 1 -- 172.21.15.33:0/4264213284 >> v1:172.21.15.33:6789/0 conn(0x7f4794149680 legacy=0x7f4794149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47937fe640 1 -- 172.21.15.33:0/4264213284 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678953539 0 0) 0x7f479414cc70 con 0x7f479414d750 2024-04-25T15:20:19.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.854+0000 7f47991e6640 1 -- 172.21.15.33:0/4264213284 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479414cf50 con 0x7f4794153000 2024-04-25T15:20:19.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.855+0000 7f47991e6640 1 --2- 172.21.15.33:0/4264213284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4794153000 0x7f4794155420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f478c009d90 tx=0x7f478c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b5c35853817c80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:19.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.855+0000 7f47937fe640 1 -- 172.21.15.33:0/4264213284 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c007740 con 0x7f4794153000 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.855+0000 7f47937fe640 1 -- 172.21.15.33:0/4264213284 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f478c0078e0 con 0x7f4794153000 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.855+0000 7f47937fe640 1 -- 172.21.15.33:0/4264213284 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c007cb0 con 0x7f4794153000 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.856+0000 7f479ac49640 1 -- 172.21.15.33:0/4264213284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4794153000 msgr2=0x7f4794155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.856+0000 7f479ac49640 1 --2- 172.21.15.33:0/4264213284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4794153000 0x7f4794155420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f478c009d90 tx=0x7f478c02a660 comp rx=0 tx=0).stop 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.856+0000 7f479ac49640 1 -- 172.21.15.33:0/4264213284 shutdown_connections 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.856+0000 7f479ac49640 1 --2- 172.21.15.33:0/4264213284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4794153000 0x7f4794155420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.856+0000 7f479ac49640 1 -- 172.21.15.33:0/4264213284 >> 172.21.15.33:0/4264213284 conn(0x7f47940bcba0 msgr2=0x7f47940bcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.856+0000 7f479ac49640 1 -- 172.21.15.33:0/4264213284 shutdown_connections 2024-04-25T15:20:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.856+0000 7f479ac49640 1 -- 172.21.15.33:0/4264213284 wait complete. 2024-04-25T15:20:19.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.857+0000 7f479ac49640 1 Processor -- start 2024-04-25T15:20:19.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.858+0000 7f479ac49640 1 -- start start 2024-04-25T15:20:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f479ac49640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4794149680 0x7f47941dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f479ac49640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f479414d750 0x7f4794146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f479ac49640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4794153000 0x7f479413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f479ac49640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f479406f5a0 con 0x7f4794153000 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f479ac49640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f479414dba0 con 0x7f479414d750 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f479ac49640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4794071b50 con 0x7f4794149680 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4794153000 0x7f479413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4794153000 0x7f479413fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52836/0 (socket says 172.21.15.33:52836) 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 -- 172.21.15.33:0/1496418767 learned_addr learned my addr 172.21.15.33:0/1496418767 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f4793fff640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f479414d750 0x7f4794146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47989e5640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4794149680 0x7f47941dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 -- 172.21.15.33:0/1496418767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4794149680 msgr2=0x7f47941dfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4794149680 0x7f47941dfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 -- 172.21.15.33:0/1496418767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f479414d750 msgr2=0x7f4794146240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f479414d750 0x7f4794146240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 -- 172.21.15.33:0/1496418767 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47941dffc0 con 0x7f4794153000 2024-04-25T15:20:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.859+0000 7f47991e6640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4794153000 0x7f479413fcf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f478c009d90 tx=0x7f478c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.860+0000 7f47917fa640 1 -- 172.21.15.33:0/1496418767 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c040070 con 0x7f4794153000 2024-04-25T15:20:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.860+0000 7f47917fa640 1 -- 172.21.15.33:0/1496418767 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f478c031b40 con 0x7f4794153000 2024-04-25T15:20:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.860+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47941df580 con 0x7f4794153000 2024-04-25T15:20:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.860+0000 7f47917fa640 1 -- 172.21.15.33:0/1496418767 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c03c420 con 0x7f4794153000 2024-04-25T15:20:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.860+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479414e210 con 0x7f4794153000 2024-04-25T15:20:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.860+0000 7f47917fa640 1 -- 172.21.15.33:0/1496418767 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f478c039040 con 0x7f4794153000 2024-04-25T15:20:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.860+0000 7f47917fa640 1 -- 172.21.15.33:0/1496418767 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f478c044b30 con 0x7f4794153000 2024-04-25T15:20:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.861+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4794069ae0 con 0x7f4794153000 2024-04-25T15:20:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.864+0000 7f47917fa640 1 -- 172.21.15.33:0/1496418767 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f478c062e50 con 0x7f4794153000 2024-04-25T15:20:19.869 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:19.868+0000 7fae5b42e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T15:20:19.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.926+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47940764e0 con 0x7f4794153000 2024-04-25T15:20:19.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.926+0000 7f47917fa640 1 -- 172.21.15.33:0/1496418767 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f478c051030 con 0x7f4794153000 2024-04-25T15:20:19.930 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:19.930 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:19.658127+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4794153000 msgr2=0x7f479413fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4794153000 0x7f479413fcf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f478c009d90 tx=0x7f478c004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 shutdown_connections 2024-04-25T15:20:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4794153000 0x7f479413fcf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f479414d750 0x7f4794146240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 --2- 172.21.15.33:0/1496418767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4794149680 0x7f47941dfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 >> 172.21.15.33:0/1496418767 conn(0x7f47940bcba0 msgr2=0x7f47940b7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 shutdown_connections 2024-04-25T15:20:19.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:19.927+0000 7f479ac49640 1 -- 172.21.15.33:0/1496418767 wait complete. 2024-04-25T15:20:19.943 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T15:20:19.943 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T15:20:20.130 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:20.130+0000 7ff14e61b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:20:20.131 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:20.129+0000 7fae5b42e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T15:20:20.183 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:20.182+0000 7fae5b42e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:20:20.184 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:20.184+0000 7ff14e61b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T15:20:20.299 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:20.298+0000 7fae5b42e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T15:20:20.301 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-04-25T15:20:20.300+0000 7f9f38f31640 -1 Falling back to public interface 2024-04-25T15:20:20.302 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-25T15:20:20.301+0000 7f50a1c1d640 -1 Falling back to public interface 2024-04-25T15:20:20.306 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:20.306+0000 7ff14e61b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T15:20:20.317 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-04-25T15:20:20.316+0000 7febcc0f0640 -1 Falling back to public interface 2024-04-25T15:20:20.323 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-25T15:20:20.322+0000 7fd5976af640 -1 Falling back to public interface 2024-04-25T15:20:20.323 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-25T15:20:20.322+0000 7fdc70c33640 -1 Falling back to public interface 2024-04-25T15:20:20.326 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-04-25T15:20:20.326+0000 7f8e0860d640 -1 Falling back to public interface 2024-04-25T15:20:20.331 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-04-25T15:20:20.330+0000 7fdf2ef18640 -1 Falling back to public interface 2024-04-25T15:20:20.340 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-25T15:20:20.339+0000 7f778b557640 -1 Falling back to public interface 2024-04-25T15:20:20.585 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:20.584+0000 7fae5b42e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:20:20.604 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:20.604+0000 7ff14e61b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T15:20:20.635 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:20.634+0000 7fae5b42e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:20:20.655 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:20.654+0000 7ff14e61b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T15:20:20.749 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:20.789 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:20.788+0000 7fae5b42e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:20:20.821 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:20.821+0000 7ff14e61b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T15:20:20.853 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.852+0000 7f1f113be640 1 Processor -- start 2024-04-25T15:20:20.853 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.852+0000 7f1f113be640 1 -- start start 2024-04-25T15:20:20.854 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.853+0000 7f1f113be640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c09df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:20.854 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.853+0000 7f1f113be640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1f0c149a60 0x7f1f0c149e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.853+0000 7f1f113be640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0c0a1650 con 0x7f1f0c0b22c0 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.853+0000 7f1f113be640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0c09c920 con 0x7f1f0c149a60 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.853+0000 7f1f113be640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c09d3e0 con 0x7f1f0c09c510 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.853+0000 7f1f0affd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1f0c0b22c0 0x7f1f0c0ba880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55932/0 (socket says 172.21.15.33:55932) 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.853+0000 7f1f0affd640 1 -- 172.21.15.33:0/3132462859 learned_addr learned my addr 172.21.15.33:0/3132462859 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f0a7fc640 1 --2- 172.21.15.33:0/3132462859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c09df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f0b7fe640 1 --2- 172.21.15.33:0/3132462859 >> v2:172.21.15.155:3300/0 conn(0x7f1f0c149a60 0x7f1f0c149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f09ffb640 1 -- 172.21.15.33:0/3132462859 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568774468 0 0) 0x7f1f0c0a1650 con 0x7f1f0c0b22c0 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f09ffb640 1 -- 172.21.15.33:0/3132462859 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ef8003520 con 0x7f1f0c0b22c0 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f0a7fc640 1 -- 172.21.15.33:0/3132462859 >> v2:172.21.15.155:3300/0 conn(0x7f1f0c149a60 msgr2=0x7f1f0c149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f0a7fc640 1 --2- 172.21.15.33:0/3132462859 >> v2:172.21.15.155:3300/0 conn(0x7f1f0c149a60 0x7f1f0c149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f0a7fc640 1 -- 172.21.15.33:0/3132462859 >> v1:172.21.15.33:6789/0 conn(0x7f1f0c0b22c0 legacy=0x7f1f0c0ba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f0a7fc640 1 -- 172.21.15.33:0/3132462859 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c09d6c0 con 0x7f1f0c09c510 2024-04-25T15:20:20.855 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.854+0000 7f1f0b7fe640 1 --2- 172.21.15.33:0/3132462859 >> v2:172.21.15.155:3300/0 conn(0x7f1f0c149a60 0x7f1f0c149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.855+0000 7f1f0a7fc640 1 --2- 172.21.15.33:0/3132462859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c09df70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40097a0 tx=0x7f1ef402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cbedf3adb6a13f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.855+0000 7f1f09ffb640 1 -- 172.21.15.33:0/3132462859 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4037070 con 0x7f1f0c09c510 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.855+0000 7f1f09ffb640 1 -- 172.21.15.33:0/3132462859 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef402adb0 con 0x7f1f0c09c510 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.855+0000 7f1f09ffb640 1 -- 172.21.15.33:0/3132462859 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4032660 con 0x7f1f0c09c510 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.856+0000 7f1f113be640 1 -- 172.21.15.33:0/3132462859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 msgr2=0x7f1f0c09df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.856+0000 7f1f113be640 1 --2- 172.21.15.33:0/3132462859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c09df70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1ef40097a0 tx=0x7f1ef402a060 comp rx=0 tx=0).stop 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.856+0000 7f1f113be640 1 -- 172.21.15.33:0/3132462859 shutdown_connections 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.856+0000 7f1f113be640 1 --2- 172.21.15.33:0/3132462859 >> v2:172.21.15.155:3300/0 conn(0x7f1f0c149a60 0x7f1f0c149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.856+0000 7f1f113be640 1 --2- 172.21.15.33:0/3132462859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c09df70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.856+0000 7f1f113be640 1 -- 172.21.15.33:0/3132462859 >> 172.21.15.33:0/3132462859 conn(0x7f1f0c0bb6b0 msgr2=0x7f1f0c0bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.856+0000 7f1f113be640 1 -- 172.21.15.33:0/3132462859 shutdown_connections 2024-04-25T15:20:20.857 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.856+0000 7f1f113be640 1 -- 172.21.15.33:0/3132462859 wait complete. 2024-04-25T15:20:20.858 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.857+0000 7f1f113be640 1 Processor -- start 2024-04-25T15:20:20.858 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.857+0000 7f1f113be640 1 -- start start 2024-04-25T15:20:20.860 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.858+0000 7f1f113be640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c0a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:20.860 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.858+0000 7f1f113be640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c0b22c0 0x7f1f0c0b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:20.860 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.858+0000 7f1f113be640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f0c149a60 0x7f1f0c0a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:20.860 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.858+0000 7f1f113be640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c154480 con 0x7f1f0c149a60 2024-04-25T15:20:20.860 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.858+0000 7f1f113be640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c154300 con 0x7f1f0c0b22c0 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.858+0000 7f1f113be640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c154600 con 0x7f1f0c09c510 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f0c149a60 0x7f1f0c0a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f0c149a60 0x7f1f0c0a34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52844/0 (socket says 172.21.15.33:52844) 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0b7fe640 1 -- 172.21.15.33:0/655064134 learned_addr learned my addr 172.21.15.33:0/655064134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0affd640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c0a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0a7fc640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c0b22c0 0x7f1f0c0b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0affd640 1 -- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c0b22c0 msgr2=0x7f1f0c0b7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0affd640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c0b22c0 0x7f1f0c0b7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0affd640 1 -- 172.21.15.33:0/655064134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f0c149a60 msgr2=0x7f1f0c0a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:20.861 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0affd640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f0c149a60 0x7f1f0c0a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0affd640 1 -- 172.21.15.33:0/655064134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0a4230 con 0x7f1f0c09c510 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f0affd640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c0a2290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400c9f0 tx=0x7f1f0400ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f037fe640 1 -- 172.21.15.33:0/655064134 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04017070 con 0x7f1f0c09c510 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f037fe640 1 -- 172.21.15.33:0/655064134 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0400ab70 con 0x7f1f0c09c510 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c1407c0 con 0x7f1f0c09c510 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.859+0000 7f1f037fe640 1 -- 172.21.15.33:0/655064134 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04012400 con 0x7f1f0c09c510 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.860+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c0a1a90 con 0x7f1f0c09c510 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.860+0000 7f1f037fe640 1 -- 172.21.15.33:0/655064134 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f0401a070 con 0x7f1f0c09c510 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.860+0000 7f1f037fe640 1 -- 172.21.15.33:0/655064134 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1f04012c70 con 0x7f1f0c09c510 2024-04-25T15:20:20.862 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.860+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c076c80 con 0x7f1f0c09c510 2024-04-25T15:20:20.865 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.864+0000 7f1f037fe640 1 -- 172.21.15.33:0/655064134 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1f04021070 con 0x7f1f0c09c510 2024-04-25T15:20:20.928 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.927+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f0c1494f0 con 0x7f1f0c09c510 2024-04-25T15:20:20.929 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:20.928+0000 7fae5b42e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:20:20.930 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.929+0000 7f1f037fe640 1 -- 172.21.15.33:0/655064134 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1f040125a0 con 0x7f1f0c09c510 2024-04-25T15:20:20.930 INFO:teuthology.misc.health.smithi033.stdout: 2024-04-25T15:20:20.930 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":10,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:19.658127+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:20.932 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.929+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 msgr2=0x7f1f0c0a2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:20.932 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.929+0000 7f1f113be640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c0a2290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400c9f0 tx=0x7f1f0400ceb0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.932 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.929+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 shutdown_connections 2024-04-25T15:20:20.932 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.929+0000 7f1f113be640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f0c149a60 0x7f1f0c0a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.932 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.929+0000 7f1f113be640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c0b22c0 0x7f1f0c0b7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.933 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.929+0000 7f1f113be640 1 --2- 172.21.15.33:0/655064134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c09c510 0x7f1f0c0a2290 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:20.933 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.930+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 >> 172.21.15.33:0/655064134 conn(0x7f1f0c0bb6b0 msgr2=0x7f1f0c1479d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:20.933 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.930+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 shutdown_connections 2024-04-25T15:20:20.933 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:20.930+0000 7f1f113be640 1 -- 172.21.15.33:0/655064134 wait complete. 2024-04-25T15:20:20.940 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T15:20:20.969 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:20.969+0000 7ff14e61b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T15:20:20.979 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:20.978+0000 7fae5b42e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:20:21.021 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:21.021+0000 7ff14e61b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T15:20:21.050 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:21.049+0000 7fae5b42e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:20:21.095 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:21.094+0000 7ff14e61b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T15:20:21.095 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:21.094+0000 7fae5b42e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:20:21.142 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:21.142+0000 7ff14e61b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T15:20:21.575 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:21.574+0000 7fae5b42e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:20:21.645 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:21.644+0000 7ff14e61b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T15:20:21.691 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:21.690+0000 7fae5b42e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:20:21.767 INFO:tasks.ceph.mgr.y.smithi033.stderr:2024-04-25T15:20:21.767+0000 7ff14e61b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T15:20:22.711 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:22.709+0000 7fadfadfd640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T15:20:22.711 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-04-25T15:20:22.709+0000 7fadfadfd640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T15:20:23.776 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-04-25T15:20:23.775+0000 7f9f38f31640 -1 osd.1 0 log_to_monitors true 2024-04-25T15:20:23.809 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-25T15:20:23.808+0000 7fdc70c33640 -1 osd.7 0 log_to_monitors true 2024-04-25T15:20:23.818 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-04-25T15:20:23.816+0000 7febcc0f0640 -1 osd.3 0 log_to_monitors true 2024-04-25T15:20:23.846 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-04-25T15:20:23.845+0000 7fdf2ef18640 -1 osd.0 0 log_to_monitors true 2024-04-25T15:20:23.846 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-25T15:20:23.845+0000 7f50a1c1d640 -1 osd.5 0 log_to_monitors true 2024-04-25T15:20:23.855 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-04-25T15:20:23.855+0000 7f8e0860d640 -1 osd.2 0 log_to_monitors true 2024-04-25T15:20:23.855 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-25T15:20:23.854+0000 7fd5976af640 -1 osd.6 0 log_to_monitors true 2024-04-25T15:20:23.866 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-25T15:20:23.865+0000 7f778b557640 -1 osd.4 0 log_to_monitors true 2024-04-25T15:20:27.747 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:27.819 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-25T15:20:27.818+0000 7fdc6c180640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T15:20:27.820 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-04-25T15:20:27.818+0000 7fdf2aeae640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T15:20:27.827 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-25T15:20:27.826+0000 7f509dbb3640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T15:20:27.833 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-04-25T15:20:27.832+0000 7fdc63f8c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:20:27.837 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-04-25T15:20:27.836+0000 7f50959ae640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:20:27.840 INFO:tasks.ceph.osd.0.smithi033.stderr:2024-04-25T15:20:27.839+0000 7fdf22ca9640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:20:27.848 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-25T15:20:27.847+0000 7f77874ed640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T15:20:27.854 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-25T15:20:27.853+0000 7fd593645640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T15:20:27.858 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-04-25T15:20:27.857+0000 7f777f2e8640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:20:27.865 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-04-25T15:20:27.864+0000 7fd58b440640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:20:27.886 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-04-25T15:20:27.885+0000 7febc8086640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T15:20:27.898 INFO:tasks.ceph.osd.3.smithi033.stderr:2024-04-25T15:20:27.897+0000 7febbfe81640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:20:27.906 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.905+0000 7fb92a6d8640 1 Processor -- start 2024-04-25T15:20:27.907 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.905+0000 7fb92a6d8640 1 -- start start 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.906+0000 7fb92a6d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9240a0a60 0x7fb9240a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.906+0000 7fb92a6d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb92409df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.906+0000 7fb92a6d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9240b5c10 con 0x7fb92409c5c0 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.906+0000 7fb92a6d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb92409d6b0 con 0x7fb9240a0a60 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.906+0000 7fb92a6d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb92414d870 con 0x7fb92409db40 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb928c75640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb92409df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb928c75640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb92409df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:33056/0 (socket says 172.21.15.33:33056) 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb923fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb92409c5c0 0x7fb92414d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:36124/0 (socket says 172.21.15.33:36124) 2024-04-25T15:20:27.911 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb928c75640 1 -- 172.21.15.33:0/1143869744 learned_addr learned my addr 172.21.15.33:0/1143869744 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb9237fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb9240a0a60 0x7fb9240a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb922ffd640 1 -- 172.21.15.33:0/1143869744 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2845278152 0 0) 0x7fb9240b5c10 con 0x7fb92409c5c0 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb928c75640 1 -- 172.21.15.33:0/1143869744 >> v2:172.21.15.155:3300/0 conn(0x7fb9240a0a60 msgr2=0x7fb9240a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb928c75640 1 --2- 172.21.15.33:0/1143869744 >> v2:172.21.15.155:3300/0 conn(0x7fb9240a0a60 0x7fb9240a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb928c75640 1 -- 172.21.15.33:0/1143869744 >> v1:172.21.15.155:6789/0 conn(0x7fb92409c5c0 legacy=0x7fb92414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.907+0000 7fb928c75640 1 -- 172.21.15.33:0/1143869744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92409c9d0 con 0x7fb92409db40 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.908+0000 7fb928c75640 1 --2- 172.21.15.33:0/1143869744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb92409df50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009e50 tx=0x7fb91c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=396781490f147848 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.908+0000 7fb922ffd640 1 -- 172.21.15.33:0/1143869744 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c036070 con 0x7fb92409db40 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.908+0000 7fb922ffd640 1 -- 172.21.15.33:0/1143869744 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c031600 con 0x7fb92409db40 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.908+0000 7fb922ffd640 1 -- 172.21.15.33:0/1143869744 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0319d0 con 0x7fb92409db40 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.909+0000 7fb92a6d8640 1 -- 172.21.15.33:0/1143869744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 msgr2=0x7fb92409df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.909+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/1143869744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb92409df50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009e50 tx=0x7fb91c02a680 comp rx=0 tx=0).stop 2024-04-25T15:20:27.912 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.909+0000 7fb92a6d8640 1 -- 172.21.15.33:0/1143869744 shutdown_connections 2024-04-25T15:20:27.913 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.909+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/1143869744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb92409df50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:27.913 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.909+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/1143869744 >> v2:172.21.15.155:3300/0 conn(0x7fb9240a0a60 0x7fb9240a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:27.913 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.909+0000 7fb92a6d8640 1 -- 172.21.15.33:0/1143869744 >> 172.21.15.33:0/1143869744 conn(0x7fb9240bb7d0 msgr2=0x7fb9240bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:27.913 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.909+0000 7fb92a6d8640 1 -- 172.21.15.33:0/1143869744 shutdown_connections 2024-04-25T15:20:27.913 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.909+0000 7fb92a6d8640 1 -- 172.21.15.33:0/1143869744 wait complete. 2024-04-25T15:20:27.915 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.910+0000 7fb92a6d8640 1 Processor -- start 2024-04-25T15:20:27.915 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.911+0000 7fb92a6d8640 1 -- start start 2024-04-25T15:20:27.915 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb92a6d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb92409c5c0 0x7fb9240b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:27.915 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb92a6d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb9241e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:27.915 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb92a6d8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9240a0a60 0x7fb9241e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:27.915 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb92a6d8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb92409e490 con 0x7fb9240a0a60 2024-04-25T15:20:27.915 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb92a6d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb92414dda0 con 0x7fb92409c5c0 2024-04-25T15:20:27.915 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb92a6d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb9240bb530 con 0x7fb92409db40 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb928c75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9240a0a60 0x7fb9241e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb928c75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9240a0a60 0x7fb9241e3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35110/0 (socket says 172.21.15.33:35110) 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb928c75640 1 -- 172.21.15.33:0/375880343 learned_addr learned my addr 172.21.15.33:0/375880343 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb923fff640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb92409c5c0 0x7fb9240b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb9237fe640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb9241e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb928c75640 1 -- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 msgr2=0x7fb9241e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb928c75640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb9241e38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb928c75640 1 -- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb92409c5c0 msgr2=0x7fb9240b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb928c75640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb92409c5c0 0x7fb9240b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.912+0000 7fb928c75640 1 -- 172.21.15.33:0/375880343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9240b46c0 con 0x7fb9240a0a60 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.913+0000 7fb928c75640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9240a0a60 0x7fb9241e3e00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb91c034040 tx=0x7fb91c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.913+0000 7fb920ff9640 1 -- 172.21.15.33:0/375880343 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c036050 con 0x7fb9240a0a60 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.913+0000 7fb920ff9640 1 -- 172.21.15.33:0/375880343 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c042070 con 0x7fb9240a0a60 2024-04-25T15:20:27.916 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.913+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9240b35a0 con 0x7fb9240a0a60 2024-04-25T15:20:27.917 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.913+0000 7fb920ff9640 1 -- 172.21.15.33:0/375880343 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c009510 con 0x7fb9240a0a60 2024-04-25T15:20:27.917 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.913+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9241e4520 con 0x7fb9240a0a60 2024-04-25T15:20:27.917 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.914+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb924069ad0 con 0x7fb9240a0a60 2024-04-25T15:20:27.918 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.915+0000 7fb920ff9640 1 -- 172.21.15.33:0/375880343 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7fb91c007bf0 con 0x7fb9240a0a60 2024-04-25T15:20:27.918 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.916+0000 7fb920ff9640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb910074420 0x7fb910076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:27.918 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.916+0000 7fb920ff9640 1 -- 172.21.15.33:0/375880343 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fb91c0b51c0 con 0x7fb9240a0a60 2024-04-25T15:20:27.918 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.916+0000 7fb923fff640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb910074420 0x7fb910076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:27.918 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.917+0000 7fb923fff640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb910074420 0x7fb910076930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb914007fd0 tx=0x7fb914007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:27.927 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:27.926+0000 7fb920ff9640 1 -- 172.21.15.33:0/375880343 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb924069ad0 con 0x7fb9240a0a60 2024-04-25T15:20:27.928 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-04-25T15:20:27.927+0000 7f9f356db640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T15:20:27.943 INFO:tasks.ceph.osd.1.smithi033.stderr:2024-04-25T15:20:27.942+0000 7f9f2ccc2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:20:27.950 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-04-25T15:20:27.949+0000 7f8e047ac640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T15:20:27.965 INFO:tasks.ceph.osd.2.smithi033.stderr:2024-04-25T15:20:27.964+0000 7f8dfbd93640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T15:20:28.118 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.116+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9240a4cd0 con 0x7fb9240a0a60 2024-04-25T15:20:28.119 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.117+0000 7fb920ff9640 1 -- 172.21.15.33:0/375880343 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fb9240b46c0 con 0x7fb9240a0a60 2024-04-25T15:20:28.119 INFO:teuthology.misc.health.smithi033.stdout: 2024-04-25T15:20:28.119 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":12,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:25.711656+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:28.121 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb910074420 msgr2=0x7fb910076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:28.121 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb910074420 0x7fb910076930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb914007fd0 tx=0x7fb914007de0 comp rx=0 tx=0).stop 2024-04-25T15:20:28.121 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9240a0a60 msgr2=0x7fb9241e3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:28.121 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9240a0a60 0x7fb9241e3e00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb91c034040 tx=0x7fb91c004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:28.122 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 shutdown_connections 2024-04-25T15:20:28.122 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb910074420 0x7fb910076930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:28.122 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9240a0a60 0x7fb9241e3e00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:28.122 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb92409db40 0x7fb9241e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:28.122 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 --2- 172.21.15.33:0/375880343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb92409c5c0 0x7fb9240b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:28.122 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 >> 172.21.15.33:0/375880343 conn(0x7fb9240bb7d0 msgr2=0x7fb92406d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:28.122 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.119+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 shutdown_connections 2024-04-25T15:20:28.122 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:28.120+0000 7fb92a6d8640 1 -- 172.21.15.33:0/375880343 wait complete. 2024-04-25T15:20:28.132 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T15:20:34.940 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:35.057 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.055+0000 7f140c984640 1 Processor -- start 2024-04-25T15:20:35.057 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.055+0000 7f140c984640 1 -- start start 2024-04-25T15:20:35.059 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.056+0000 7f140c984640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14080b22c0 0x7f140809c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.059 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.056+0000 7f140c984640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1408149a60 0x7f1408149e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.059 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.056+0000 7f140c984640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14080a1650 con 0x7f140809df70 2024-04-25T15:20:35.059 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.056+0000 7f140c984640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f140809d3e0 con 0x7f14080b22c0 2024-04-25T15:20:35.059 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.056+0000 7f140c984640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f140809d6c0 con 0x7f1408149a60 2024-04-25T15:20:35.059 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.056+0000 7f140659c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14080b22c0 0x7f140809c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.059 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.057+0000 7f1405d9b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f140809df70 0x7f14080ba880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50498/0 (socket says 172.21.15.33:50498) 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.057+0000 7f1405d9b640 1 -- 172.21.15.33:0/1131501888 learned_addr learned my addr 172.21.15.33:0/1131501888 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.057+0000 7f1406d9d640 1 --2- 172.21.15.33:0/1131501888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1408149a60 0x7f1408149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.057+0000 7f140659c640 1 -- 172.21.15.33:0/1131501888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1408149a60 msgr2=0x7f1408149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.057+0000 7f140659c640 1 --2- 172.21.15.33:0/1131501888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1408149a60 0x7f1408149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.057+0000 7f140659c640 1 -- 172.21.15.33:0/1131501888 >> v1:172.21.15.33:6789/0 conn(0x7f140809df70 legacy=0x7f14080ba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.057+0000 7f140659c640 1 -- 172.21.15.33:0/1131501888 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080baf90 con 0x7f14080b22c0 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.058+0000 7f140659c640 1 --2- 172.21.15.33:0/1131501888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f140809c510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f13f80097a0 tx=0x7f13f802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2570e08315849892 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.058+0000 7f140559a640 1 -- 172.21.15.33:0/1131501888 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8037070 con 0x7f14080b22c0 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.058+0000 7f140559a640 1 -- 172.21.15.33:0/1131501888 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f802adb0 con 0x7f14080b22c0 2024-04-25T15:20:35.060 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.058+0000 7f140559a640 1 -- 172.21.15.33:0/1131501888 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8032660 con 0x7f14080b22c0 2024-04-25T15:20:35.062 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.058+0000 7f140c984640 1 -- 172.21.15.33:0/1131501888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 msgr2=0x7f140809c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.062 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.058+0000 7f140c984640 1 --2- 172.21.15.33:0/1131501888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f140809c510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f13f80097a0 tx=0x7f13f802a060 comp rx=0 tx=0).stop 2024-04-25T15:20:35.062 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.059+0000 7f140c984640 1 -- 172.21.15.33:0/1131501888 shutdown_connections 2024-04-25T15:20:35.062 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.059+0000 7f140c984640 1 --2- 172.21.15.33:0/1131501888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1408149a60 0x7f1408149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.062 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.059+0000 7f140c984640 1 --2- 172.21.15.33:0/1131501888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f140809c510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.063 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.059+0000 7f140c984640 1 -- 172.21.15.33:0/1131501888 >> 172.21.15.33:0/1131501888 conn(0x7f14080bb6b0 msgr2=0x7f14080bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:35.063 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.059+0000 7f140c984640 1 -- 172.21.15.33:0/1131501888 shutdown_connections 2024-04-25T15:20:35.063 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.059+0000 7f140c984640 1 -- 172.21.15.33:0/1131501888 wait complete. 2024-04-25T15:20:35.063 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.060+0000 7f140c984640 1 Processor -- start 2024-04-25T15:20:35.063 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.060+0000 7f140c984640 1 -- start start 2024-04-25T15:20:35.067 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.061+0000 7f140c984640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f140809df70 0x7f14081e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.067 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.061+0000 7f140c984640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f14080adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.068 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.061+0000 7f140c984640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1408149a60 0x7f14080ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.068 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.061+0000 7f140c984640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1408154480 con 0x7f14080b22c0 2024-04-25T15:20:35.068 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.061+0000 7f140c984640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1408154300 con 0x7f1408149a60 2024-04-25T15:20:35.068 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.061+0000 7f140c984640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1408154600 con 0x7f140809df70 2024-04-25T15:20:35.068 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.061+0000 7f1405d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f14080adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.068 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.061+0000 7f1405d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f14080adef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56760/0 (socket says 172.21.15.33:56760) 2024-04-25T15:20:35.068 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f1405d9b640 1 -- 172.21.15.33:0/242443319 learned_addr learned my addr 172.21.15.33:0/242443319 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:35.068 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f140659c640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f140809df70 0x7f14081e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.069 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f1406d9d640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1408149a60 0x7f14080ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.069 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f1405d9b640 1 -- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f140809df70 msgr2=0x7f14081e3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.069 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f1405d9b640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f140809df70 0x7f14081e3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.069 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f1405d9b640 1 -- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1408149a60 msgr2=0x7f14080ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.069 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f1405d9b640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1408149a60 0x7f14080ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.069 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f1405d9b640 1 -- 172.21.15.33:0/242443319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14080b84d0 con 0x7f14080b22c0 2024-04-25T15:20:35.069 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f1405d9b640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f14080adef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c3f0 tx=0x7f13fc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.069 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f13f6ffd640 1 -- 172.21.15.33:0/242443319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc017070 con 0x7f14080b22c0 2024-04-25T15:20:35.070 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f13f6ffd640 1 -- 172.21.15.33:0/242443319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc005ce0 con 0x7f14080b22c0 2024-04-25T15:20:35.070 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f13f6ffd640 1 -- 172.21.15.33:0/242443319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0072f0 con 0x7f14080b22c0 2024-04-25T15:20:35.070 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14080b8b90 con 0x7f14080b22c0 2024-04-25T15:20:35.070 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.062+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14080b81f0 con 0x7f14080b22c0 2024-04-25T15:20:35.070 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.064+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1408076c80 con 0x7f14080b22c0 2024-04-25T15:20:35.070 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.064+0000 7f13f6ffd640 1 -- 172.21.15.33:0/242443319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f13fc01a070 con 0x7f14080b22c0 2024-04-25T15:20:35.070 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.064+0000 7f13f6ffd640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f13e80744b0 0x7f13e80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.070 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.065+0000 7f13f6ffd640 1 -- 172.21.15.33:0/242443319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f13fc094070 con 0x7f14080b22c0 2024-04-25T15:20:35.071 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.065+0000 7f140659c640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f13e80744b0 0x7f13e80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.071 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.066+0000 7f140659c640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f13e80744b0 0x7f13e80769c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.071 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.070+0000 7f13f6ffd640 1 -- 172.21.15.33:0/242443319 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f13fc05e620 con 0x7f14080b22c0 2024-04-25T15:20:35.261 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.259+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14081495d0 con 0x7f14080b22c0 2024-04-25T15:20:35.262 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.260+0000 7f13f6ffd640 1 -- 172.21.15.33:0/242443319 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f13fc062920 con 0x7f14080b22c0 2024-04-25T15:20:35.262 INFO:teuthology.misc.health.smithi033.stdout: 2024-04-25T15:20:35.262 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":16,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:31.840496+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:35.265 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f13e80744b0 msgr2=0x7f13e80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.265 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f13e80744b0 0x7f13e80769c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f802e000 comp rx=0 tx=0).stop 2024-04-25T15:20:35.265 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 msgr2=0x7f14080adef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.265 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f14080adef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c3f0 tx=0x7f13fc00c8b0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.265 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 shutdown_connections 2024-04-25T15:20:35.265 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f13e80744b0 0x7f13e80769c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.266 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1408149a60 0x7f14080ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.266 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14080b22c0 0x7f14080adef0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.266 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 --2- 172.21.15.33:0/242443319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f140809df70 0x7f14081e3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.266 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 >> 172.21.15.33:0/242443319 conn(0x7f14080bb6b0 msgr2=0x7f140809f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:35.266 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 shutdown_connections 2024-04-25T15:20:35.266 INFO:teuthology.misc.health.smithi033.stderr:2024-04-25T15:20:35.262+0000 7f140c984640 1 -- 172.21.15.33:0/242443319 wait complete. 2024-04-25T15:20:35.274 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T15:20:35.274 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T15:20:35.274 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T15:20:35.275 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T15:20:35.277 INFO:tasks.ceph.mds.a:Started 2024-04-25T15:20:35.277 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T15:20:35.277 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T15:20:35.281 INFO:tasks.ceph.mds.b:Started 2024-04-25T15:20:35.281 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T15:20:35.281 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:35.362 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-04-25T15:20:35.375 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-04-25T15:20:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.393+0000 7f7c4bb2e640 1 Processor -- start 2024-04-25T15:20:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.393+0000 7f7c4bb2e640 1 -- start start 2024-04-25T15:20:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.394+0000 7f7c4bb2e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7c4406f320 0x7f7c44070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.394+0000 7f7c4bb2e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c440a2870 con 0x7f7c4406dfd0 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.394+0000 7f7c4bb2e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4406ee90 con 0x7f7c4406dbc0 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.394+0000 7f7c4bb2e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7c4406f730 con 0x7f7c4406f320 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c4a0cb640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7c4406dfd0 0x7f7c441541e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50504/0 (socket says 172.21.15.33:50504) 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c4a0cb640 1 -- 172.21.15.33:0/145965492 learned_addr learned my addr 172.21.15.33:0/145965492 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c498ca640 1 --2- 172.21.15.33:0/145965492 >> v2:172.21.15.155:3300/0 conn(0x7f7c4406f320 0x7f7c44070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c488c8640 1 -- 172.21.15.33:0/145965492 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772621372 0 0) 0x7f7c440a2870 con 0x7f7c4406dfd0 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c488c8640 1 -- 172.21.15.33:0/145965492 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c30003520 con 0x7f7c4406dfd0 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c498ca640 1 -- 172.21.15.33:0/145965492 >> v1:172.21.15.155:6789/0 conn(0x7f7c4406dbc0 legacy=0x7f7c44149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c488c8640 1 -- 172.21.15.33:0/145965492 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291387222 0 0) 0x7f7c4406ee90 con 0x7f7c4406dbc0 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c498ca640 1 -- 172.21.15.33:0/145965492 >> v1:172.21.15.33:6789/0 conn(0x7f7c4406dfd0 legacy=0x7f7c441541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.395+0000 7f7c498ca640 1 -- 172.21.15.33:0/145965492 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c440a22b0 con 0x7f7c4406f320 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.396+0000 7f7c498ca640 1 --2- 172.21.15.33:0/145965492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406f320 0x7f7c44070550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c4406f8b0 tx=0x7f7c4002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f399ac1a0d8742c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.396+0000 7f7c488c8640 1 -- 172.21.15.33:0/145965492 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40037070 con 0x7f7c4406f320 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.396+0000 7f7c488c8640 1 -- 172.21.15.33:0/145965492 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4002ab90 con 0x7f7c4406f320 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.396+0000 7f7c488c8640 1 -- 172.21.15.33:0/145965492 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0019f0 con 0x7f7c4406f320 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.397+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/145965492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406f320 msgr2=0x7f7c44070550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.397+0000 7f7c4bb2e640 1 --2- 172.21.15.33:0/145965492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406f320 0x7f7c44070550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7c4406f8b0 tx=0x7f7c4002a100 comp rx=0 tx=0).stop 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.397+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/145965492 shutdown_connections 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.397+0000 7f7c4bb2e640 1 --2- 172.21.15.33:0/145965492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406f320 0x7f7c44070550 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.397+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/145965492 >> 172.21.15.33:0/145965492 conn(0x7f7c44063ad0 msgr2=0x7f7c440bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.397+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/145965492 shutdown_connections 2024-04-25T15:20:35.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.397+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/145965492 wait complete. 2024-04-25T15:20:35.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.398+0000 7f7c4bb2e640 1 Processor -- start 2024-04-25T15:20:35.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.398+0000 7f7c4bb2e640 1 -- start start 2024-04-25T15:20:35.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4bb2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406dbc0 0x7f7c441df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4bb2e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c4406dfd0 0x7f7c440b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4bb2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4406f320 0x7f7c441418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4bb2e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7c440717e0 con 0x7f7c4406f320 2024-04-25T15:20:35.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4bb2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c44149940 con 0x7f7c4406dbc0 2024-04-25T15:20:35.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4bb2e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4414a510 con 0x7f7c4406dfd0 2024-04-25T15:20:35.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4a0cb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4406f320 0x7f7c441418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4a0cb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4406f320 0x7f7c441418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56784/0 (socket says 172.21.15.33:56784) 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c498ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406dbc0 0x7f7c441df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c4a0cb640 1 -- 172.21.15.33:0/120180326 learned_addr learned my addr 172.21.15.33:0/120180326 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.399+0000 7f7c490c9640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c4406dfd0 0x7f7c440b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c4a0cb640 1 -- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c4406dfd0 msgr2=0x7f7c440b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c4a0cb640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c4406dfd0 0x7f7c440b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c4a0cb640 1 -- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406dbc0 msgr2=0x7f7c441df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c4a0cb640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406dbc0 0x7f7c441df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c4a0cb640 1 -- 172.21.15.33:0/120180326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c441df7e0 con 0x7f7c4406f320 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c490c9640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c4406dfd0 0x7f7c440b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c498ca640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406dbc0 0x7f7c441df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c4a0cb640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4406f320 0x7f7c441418c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00caf0 tx=0x7f7c3c0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c3a7fc640 1 -- 172.21.15.33:0/120180326 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c018070 con 0x7f7c4406f320 2024-04-25T15:20:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c3a7fc640 1 -- 172.21.15.33:0/120180326 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c00a700 con 0x7f7c4406f320 2024-04-25T15:20:35.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c3a7fc640 1 -- 172.21.15.33:0/120180326 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c00aad0 con 0x7f7c4406f320 2024-04-25T15:20:35.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c441e2ab0 con 0x7f7c4406f320 2024-04-25T15:20:35.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.400+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c441e3030 con 0x7f7c4406f320 2024-04-25T15:20:35.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.401+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c440764e0 con 0x7f7c4406f320 2024-04-25T15:20:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.402+0000 7f7c3a7fc640 1 -- 172.21.15.33:0/120180326 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7c3c00ac70 con 0x7f7c4406f320 2024-04-25T15:20:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.402+0000 7f7c3a7fc640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7c280744b0 0x7f7c280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.402+0000 7f7c3a7fc640 1 -- 172.21.15.33:0/120180326 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f7c3c0945d0 con 0x7f7c4406f320 2024-04-25T15:20:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.403+0000 7f7c498ca640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7c280744b0 0x7f7c280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.403+0000 7f7c498ca640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7c280744b0 0x7f7c280769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c40034000 tx=0x7f7c4002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.407+0000 7f7c3a7fc640 1 -- 172.21.15.33:0/120180326 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c3c05e9c0 con 0x7f7c4406f320 2024-04-25T15:20:35.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.594+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c440bcc80 con 0x7f7c4406f320 2024-04-25T15:20:35.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.594+0000 7f7c3a7fc640 1 -- 172.21.15.33:0/120180326 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f7c3c062cc0 con 0x7f7c4406f320 2024-04-25T15:20:35.596 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:35.596 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:31.840496+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7c280744b0 msgr2=0x7f7c280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7c280744b0 0x7f7c280769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c40034000 tx=0x7f7c4002e000 comp rx=0 tx=0).stop 2024-04-25T15:20:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4406f320 msgr2=0x7f7c441418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4406f320 0x7f7c441418c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00caf0 tx=0x7f7c3c0020c0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 shutdown_connections 2024-04-25T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7c280744b0 0x7f7c280769c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c4406f320 0x7f7c441418c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c4406dfd0 0x7f7c440b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 --2- 172.21.15.33:0/120180326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4406dbc0 0x7f7c441df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 >> 172.21.15.33:0/120180326 conn(0x7f7c44063ad0 msgr2=0x7f7c44149000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 shutdown_connections 2024-04-25T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.596+0000 7f7c4bb2e640 1 -- 172.21.15.33:0/120180326 wait complete. 2024-04-25T15:20:35.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:20:29.721824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:20:35.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:20:35.723 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.722+0000 7ff555fd6640 1 Processor -- start 2024-04-25T15:20:35.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.722+0000 7ff555fd6640 1 -- start start 2024-04-25T15:20:35.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff555fd6640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff55006d230 0x7ff5500bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff555fd6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5500bcf30 0x7ff55009d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff555fd6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff550149d40 con 0x7ff550149840 2024-04-25T15:20:35.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff555fd6640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7ff55014a820 con 0x7ff55006d230 2024-04-25T15:20:35.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff555fd6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff55014a020 con 0x7ff5500bcf30 2024-04-25T15:20:35.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54effd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff55006d230 0x7ff5500bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54effd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff55006d230 0x7ff5500bc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56788/0 (socket says 172.21.15.33:56788) 2024-04-25T15:20:35.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54effd640 1 -- 172.21.15.33:0/3860059451 learned_addr learned my addr 172.21.15.33:0/3860059451 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:35.726 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54ffff640 1 --2- 172.21.15.33:0/3860059451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5500bcf30 0x7ff55009d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54effd640 1 -- 172.21.15.33:0/3860059451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5500bcf30 msgr2=0x7ff55009d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:35.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54effd640 1 --2- 172.21.15.33:0/3860059451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5500bcf30 0x7ff55009d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54effd640 1 -- 172.21.15.33:0/3860059451 >> v1:172.21.15.155:6789/0 conn(0x7ff550149840 legacy=0x7ff5500be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:35.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54effd640 1 -- 172.21.15.33:0/3860059451 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55014a300 con 0x7ff55006d230 2024-04-25T15:20:35.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.723+0000 7ff54ffff640 1 --2- 172.21.15.33:0/3860059451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5500bcf30 0x7ff55009d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:35.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.724+0000 7ff54effd640 1 --2- 172.21.15.33:0/3860059451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55006d230 0x7ff5500bc9f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff540009870 tx=0x7ff54002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b051eadce55718 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.727 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.724+0000 7ff54e7fc640 1 -- 172.21.15.33:0/3860059451 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540037070 con 0x7ff55006d230 2024-04-25T15:20:35.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.724+0000 7ff54e7fc640 1 -- 172.21.15.33:0/3860059451 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540032440 con 0x7ff55006d230 2024-04-25T15:20:35.728 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.724+0000 7ff54e7fc640 1 -- 172.21.15.33:0/3860059451 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540032810 con 0x7ff55006d230 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.725+0000 7ff555fd6640 1 -- 172.21.15.33:0/3860059451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55006d230 msgr2=0x7ff5500bc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.725+0000 7ff555fd6640 1 --2- 172.21.15.33:0/3860059451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55006d230 0x7ff5500bc9f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff540009870 tx=0x7ff54002a210 comp rx=0 tx=0).stop 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.725+0000 7ff555fd6640 1 -- 172.21.15.33:0/3860059451 shutdown_connections 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.725+0000 7ff555fd6640 1 --2- 172.21.15.33:0/3860059451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5500bcf30 0x7ff55009d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.725+0000 7ff555fd6640 1 --2- 172.21.15.33:0/3860059451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55006d230 0x7ff5500bc9f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.725+0000 7ff555fd6640 1 -- 172.21.15.33:0/3860059451 >> 172.21.15.33:0/3860059451 conn(0x7ff5500bebf0 msgr2=0x7ff5500bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.725+0000 7ff555fd6640 1 -- 172.21.15.33:0/3860059451 shutdown_connections 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.725+0000 7ff555fd6640 1 -- 172.21.15.33:0/3860059451 wait complete. 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.726+0000 7ff555fd6640 1 Processor -- start 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.727+0000 7ff555fd6640 1 -- start start 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff555fd6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff55006d230 0x7ff5501e0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff555fd6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5500bcf30 0x7ff5500b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.731 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff555fd6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff550149840 0x7ff5501d5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff555fd6640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff55009daa0 con 0x7ff5500bcf30 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff555fd6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff55009d920 con 0x7ff55006d230 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff555fd6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff55009dc20 con 0x7ff550149840 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5500bcf30 0x7ff5500b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5500bcf30 0x7ff5500b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56802/0 (socket says 172.21.15.33:56802) 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 -- 172.21.15.33:0/1880338446 learned_addr learned my addr 172.21.15.33:0/1880338446 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54f7fe640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff55006d230 0x7ff5501e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54ffff640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff550149840 0x7ff5501d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 -- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff550149840 msgr2=0x7ff5501d5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff550149840 0x7ff5501d5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 -- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff55006d230 msgr2=0x7ff5501e0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff55006d230 0x7ff5501e0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.732 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 -- 172.21.15.33:0/1880338446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5501df840 con 0x7ff5500bcf30 2024-04-25T15:20:35.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff54effd640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5500bcf30 0x7ff5500b42a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff540009870 tx=0x7ff5400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff537fff640 1 -- 172.21.15.33:0/1880338446 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540041020 con 0x7ff5500bcf30 2024-04-25T15:20:35.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff537fff640 1 -- 172.21.15.33:0/1880338446 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff540030970 con 0x7ff5500bcf30 2024-04-25T15:20:35.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5500a35f0 con 0x7ff5500bcf30 2024-04-25T15:20:35.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.728+0000 7ff537fff640 1 -- 172.21.15.33:0/1880338446 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540037040 con 0x7ff5500bcf30 2024-04-25T15:20:35.733 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.729+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5501df4f0 con 0x7ff5500bcf30 2024-04-25T15:20:35.734 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.729+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5501d6710 con 0x7ff5500bcf30 2024-04-25T15:20:35.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.730+0000 7ff537fff640 1 -- 172.21.15.33:0/1880338446 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff540044020 con 0x7ff5500bcf30 2024-04-25T15:20:35.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.730+0000 7ff537fff640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:35.735 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.731+0000 7ff537fff640 1 -- 172.21.15.33:0/1880338446 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff5400b5440 con 0x7ff5500bcf30 2024-04-25T15:20:35.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.731+0000 7ff54f7fe640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:35.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.731+0000 7ff54f7fe640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff53c0744b0 0x7ff53c0769c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff544006fd0 tx=0x7ff544009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:35.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.735+0000 7ff537fff640 1 -- 172.21.15.33:0/1880338446 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff54004b070 con 0x7ff5500bcf30 2024-04-25T15:20:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.919+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5501487d0 con 0x7ff5500bcf30 2024-04-25T15:20:35.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.920+0000 7ff537fff640 1 -- 172.21.15.33:0/1880338446 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7ff54007f8d0 con 0x7ff5500bcf30 2024-04-25T15:20:35.922 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff53c0744b0 msgr2=0x7ff53c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff53c0744b0 0x7ff53c0769c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff544006fd0 tx=0x7ff544009060 comp rx=0 tx=0).stop 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5500bcf30 msgr2=0x7ff5500b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5500bcf30 0x7ff5500b42a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff540009870 tx=0x7ff5400046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 shutdown_connections 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff53c0744b0 0x7ff53c0769c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff550149840 0x7ff5501d5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5500bcf30 0x7ff5500b42a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 --2- 172.21.15.33:0/1880338446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff55006d230 0x7ff5501e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 >> 172.21.15.33:0/1880338446 conn(0x7ff5500bebf0 msgr2=0x7ff5500b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 shutdown_connections 2024-04-25T15:20:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:35.922+0000 7ff555fd6640 1 -- 172.21.15.33:0/1880338446 wait complete. 2024-04-25T15:20:35.935 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:20:36.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.044+0000 7f6c316d8640 1 Processor -- start 2024-04-25T15:20:36.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.044+0000 7f6c316d8640 1 -- start start 2024-04-25T15:20:36.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.045+0000 7f6c316d8640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c2c0bdbb0 0x7f6c2c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:36.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.045+0000 7f6c316d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c1497d0 0x7f6c2c0bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:36.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.045+0000 7f6c316d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c149e40 con 0x7f6c2c0bcf30 2024-04-25T15:20:36.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.045+0000 7f6c316d8640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2c14a490 con 0x7f6c2c0bdbb0 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.045+0000 7f6c316d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c0bdfc0 con 0x7f6c2c1497d0 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.045+0000 7f6c2affd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c2c0bdbb0 0x7f6c2c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.045+0000 7f6c2affd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c2c0bdbb0 0x7f6c2c06d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56804/0 (socket says 172.21.15.33:56804) 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.045+0000 7f6c2affd640 1 -- 172.21.15.33:0/1861607576 learned_addr learned my addr 172.21.15.33:0/1861607576 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c2a7fc640 1 --2- 172.21.15.33:0/1861607576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c1497d0 0x7f6c2c0bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c2affd640 1 -- 172.21.15.33:0/1861607576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c1497d0 msgr2=0x7f6c2c0bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c2affd640 1 --2- 172.21.15.33:0/1861607576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c1497d0 0x7f6c2c0bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c2affd640 1 -- 172.21.15.33:0/1861607576 >> v1:172.21.15.155:6789/0 conn(0x7f6c2c0bcf30 legacy=0x7f6c2c09d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c2affd640 1 -- 172.21.15.33:0/1861607576 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c14a120 con 0x7f6c2c0bdbb0 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c2a7fc640 1 --2- 172.21.15.33:0/1861607576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c1497d0 0x7f6c2c0bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:36.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c2affd640 1 --2- 172.21.15.33:0/1861607576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c0bdbb0 0x7f6c2c06d380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009870 tx=0x7f6c1c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bd6b6d4abd83f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c29ffb640 1 -- 172.21.15.33:0/1861607576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c037070 con 0x7f6c2c0bdbb0 2024-04-25T15:20:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.046+0000 7f6c29ffb640 1 -- 172.21.15.33:0/1861607576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1c032440 con 0x7f6c2c0bdbb0 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c29ffb640 1 -- 172.21.15.33:0/1861607576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c032810 con 0x7f6c2c0bdbb0 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c316d8640 1 -- 172.21.15.33:0/1861607576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c0bdbb0 msgr2=0x7f6c2c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1861607576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c0bdbb0 0x7f6c2c06d380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009870 tx=0x7f6c1c02a180 comp rx=0 tx=0).stop 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c316d8640 1 -- 172.21.15.33:0/1861607576 shutdown_connections 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1861607576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c1497d0 0x7f6c2c0bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1861607576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c0bdbb0 0x7f6c2c06d380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c316d8640 1 -- 172.21.15.33:0/1861607576 >> 172.21.15.33:0/1861607576 conn(0x7f6c2c0bedd0 msgr2=0x7f6c2c0bf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c316d8640 1 -- 172.21.15.33:0/1861607576 shutdown_connections 2024-04-25T15:20:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.047+0000 7f6c316d8640 1 -- 172.21.15.33:0/1861607576 wait complete. 2024-04-25T15:20:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.049+0000 7f6c316d8640 1 Processor -- start 2024-04-25T15:20:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.049+0000 7f6c316d8640 1 -- start start 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c316d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c0bcf30 0x7f6c2c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c316d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0bdbb0 0x7f6c2c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c316d8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c1497d0 0x7f6c2c0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c316d8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c09daf0 con 0x7f6c2c1497d0 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c316d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c149be0 con 0x7f6c2c0bdbb0 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c316d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c09dc70 con 0x7f6c2c0bcf30 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c1497d0 0x7f6c2c0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c1497d0 0x7f6c2c0b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56812/0 (socket says 172.21.15.33:56812) 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2b7fe640 1 -- 172.21.15.33:0/1520722473 learned_addr learned my addr 172.21.15.33:0/1520722473 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2affd640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c0bcf30 0x7f6c2c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2a7fc640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0bdbb0 0x7f6c2c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2b7fe640 1 -- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c0bcf30 msgr2=0x7f6c2c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2b7fe640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c0bcf30 0x7f6c2c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2b7fe640 1 -- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0bdbb0 msgr2=0x7f6c2c14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2b7fe640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0bdbb0 0x7f6c2c14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.050+0000 7f6c2b7fe640 1 -- 172.21.15.33:0/1520722473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c14bf20 con 0x7f6c2c1497d0 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.051+0000 7f6c2b7fe640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c1497d0 0x7f6c2c0b14d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400ba10 tx=0x7f6c2400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.051+0000 7f6c137fe640 1 -- 172.21.15.33:0/1520722473 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24019070 con 0x7f6c2c1497d0 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.051+0000 7f6c137fe640 1 -- 172.21.15.33:0/1520722473 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2400cb40 con 0x7f6c2c1497d0 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.051+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c14d760 con 0x7f6c2c1497d0 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.051+0000 7f6c137fe640 1 -- 172.21.15.33:0/1520722473 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24014440 con 0x7f6c2c1497d0 2024-04-25T15:20:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.051+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c14c130 con 0x7f6c2c1497d0 2024-04-25T15:20:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.052+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2c0764e0 con 0x7f6c2c1497d0 2024-04-25T15:20:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.053+0000 7f6c137fe640 1 -- 172.21.15.33:0/1520722473 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6c2401c070 con 0x7f6c2c1497d0 2024-04-25T15:20:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.053+0000 7f6c137fe640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6c180744e0 0x7f6c180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.053+0000 7f6c137fe640 1 -- 172.21.15.33:0/1520722473 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6c24094910 con 0x7f6c2c1497d0 2024-04-25T15:20:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.054+0000 7f6c2affd640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6c180744e0 0x7f6c180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.054+0000 7f6c2affd640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6c180744e0 0x7f6c180769f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c034000 tx=0x7f6c1c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:36.059 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.058+0000 7f6c137fe640 1 -- 172.21.15.33:0/1520722473 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6c2405ee30 con 0x7f6c2c1497d0 2024-04-25T15:20:36.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.283+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c2c09cf30 con 0x7f6c2c1497d0 2024-04-25T15:20:36.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.284+0000 7f6c137fe640 1 -- 172.21.15.33:0/1520722473 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1386 (secure 0 0 0) 0x7f6c24063130 con 0x7f6c2c1497d0 2024-04-25T15:20:36.286 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:36.286 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/23089112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":23089112},{"type":"v1","addr":"172.21.15.33:6833","nonce":23089112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T15:20:36.286 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6c180744e0 msgr2=0x7f6c180769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6c180744e0 0x7f6c180769f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c034000 tx=0x7f6c1c02e000 comp rx=0 tx=0).stop 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c1497d0 msgr2=0x7f6c2c0b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c1497d0 0x7f6c2c0b14d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400ba10 tx=0x7f6c2400bed0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 shutdown_connections 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6c180744e0 0x7f6c180769f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c2c1497d0 0x7f6c2c0b14d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2c0bdbb0 0x7f6c2c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 --2- 172.21.15.33:0/1520722473 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c2c0bcf30 0x7f6c2c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 >> 172.21.15.33:0/1520722473 conn(0x7f6c2c0bedd0 msgr2=0x7f6c2c0bbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 shutdown_connections 2024-04-25T15:20:36.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:36.286+0000 7f6c316d8640 1 -- 172.21.15.33:0/1520722473 wait complete. 2024-04-25T15:20:37.014 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:20:37.017 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:20:38.299 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:20:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.423+0000 7f64d1540640 1 Processor -- start 2024-04-25T15:20:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.423+0000 7f64d1540640 1 -- start start 2024-04-25T15:20:38.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.424+0000 7f64d1540640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f64cc06d230 0x7f64cc09d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.424+0000 7f64d1540640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64cc0b99b0 con 0x7f64cc0ba490 2024-04-25T15:20:38.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.424+0000 7f64d1540640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64cc0b9c90 con 0x7f64cc0b9570 2024-04-25T15:20:38.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.424+0000 7f64d1540640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f64cc0b9f70 con 0x7f64cc06d230 2024-04-25T15:20:38.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.425+0000 7f64cb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f64cc06d230 0x7f64cc09d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.425+0000 7f64cb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f64cc06d230 0x7f64cc09d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56822/0 (socket says 172.21.15.33:56822) 2024-04-25T15:20:38.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.425+0000 7f64ca7fc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f64cc0ba490 0x7f64cc14cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50518/0 (socket says 172.21.15.33:50518) 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.425+0000 7f64cb7fe640 1 -- 172.21.15.33:0/2727344365 learned_addr learned my addr 172.21.15.33:0/2727344365 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.425+0000 7f64cb7fe640 1 -- 172.21.15.33:0/2727344365 >> v1:172.21.15.155:6789/0 conn(0x7f64cc0b9570 legacy=0x7f64cc0be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.425+0000 7f64cb7fe640 1 -- 172.21.15.33:0/2727344365 >> v1:172.21.15.33:6789/0 conn(0x7f64cc0ba490 legacy=0x7f64cc14cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.425+0000 7f64c9ffb640 1 -- 172.21.15.33:0/2727344365 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566772053 0 0) 0x7f64cc0b9c90 con 0x7f64cc0b9570 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.425+0000 7f64cb7fe640 1 -- 172.21.15.33:0/2727344365 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64cc06d640 con 0x7f64cc06d230 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.426+0000 7f64cb7fe640 1 --2- 172.21.15.33:0/2727344365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc06d230 0x7f64cc09d610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009e50 tx=0x7f64bc02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3205046d86b806c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.426+0000 7f64c9ffb640 1 -- 172.21.15.33:0/2727344365 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc036070 con 0x7f64cc06d230 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.426+0000 7f64c9ffb640 1 -- 172.21.15.33:0/2727344365 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64bc031600 con 0x7f64cc06d230 2024-04-25T15:20:38.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.426+0000 7f64c9ffb640 1 -- 172.21.15.33:0/2727344365 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0319d0 con 0x7f64cc06d230 2024-04-25T15:20:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.426+0000 7f64d1540640 1 -- 172.21.15.33:0/2727344365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc06d230 msgr2=0x7f64cc09d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.426+0000 7f64d1540640 1 --2- 172.21.15.33:0/2727344365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc06d230 0x7f64cc09d610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009e50 tx=0x7f64bc02a6c0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.426+0000 7f64d1540640 1 -- 172.21.15.33:0/2727344365 shutdown_connections 2024-04-25T15:20:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.426+0000 7f64d1540640 1 --2- 172.21.15.33:0/2727344365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc06d230 0x7f64cc09d610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.427+0000 7f64d1540640 1 -- 172.21.15.33:0/2727344365 >> 172.21.15.33:0/2727344365 conn(0x7f64cc0bebf0 msgr2=0x7f64cc0bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.427+0000 7f64d1540640 1 -- 172.21.15.33:0/2727344365 shutdown_connections 2024-04-25T15:20:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.427+0000 7f64d1540640 1 -- 172.21.15.33:0/2727344365 wait complete. 2024-04-25T15:20:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.428+0000 7f64d1540640 1 Processor -- start 2024-04-25T15:20:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.428+0000 7f64d1540640 1 -- start start 2024-04-25T15:20:38.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64d1540640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64cc06d230 0x7f64cc0a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64d1540640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc149af0 0x7f64cc0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64d1540640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64cc0b5190 0x7f64cc0a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64d1540640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc1550c0 con 0x7f64cc149af0 2024-04-25T15:20:38.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64d1540640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc09dde0 con 0x7f64cc0b5190 2024-04-25T15:20:38.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64d1540640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f64cc155240 con 0x7f64cc06d230 2024-04-25T15:20:38.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64ca7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc149af0 0x7f64cc0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64ca7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc149af0 0x7f64cc0b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56828/0 (socket says 172.21.15.33:56828) 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.429+0000 7f64ca7fc640 1 -- 172.21.15.33:0/1353370001 learned_addr learned my addr 172.21.15.33:0/1353370001 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64caffd640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64cc06d230 0x7f64cc0a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64cb7fe640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64cc0b5190 0x7f64cc0a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64ca7fc640 1 -- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64cc06d230 msgr2=0x7f64cc0a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64ca7fc640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64cc06d230 0x7f64cc0a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64ca7fc640 1 -- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64cc0b5190 msgr2=0x7f64cc0a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64ca7fc640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64cc0b5190 0x7f64cc0a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64ca7fc640 1 -- 172.21.15.33:0/1353370001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64cc0b37b0 con 0x7f64cc149af0 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64cb7fe640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64cc0b5190 0x7f64cc0a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64caffd640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64cc06d230 0x7f64cc0a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64ca7fc640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc149af0 0x7f64cc0b4c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c5a0 tx=0x7f64b400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64c37fe640 1 -- 172.21.15.33:0/1353370001 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b4017070 con 0x7f64cc149af0 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64c37fe640 1 -- 172.21.15.33:0/1353370001 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b40074e0 con 0x7f64cc149af0 2024-04-25T15:20:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64cc1e2680 con 0x7f64cc149af0 2024-04-25T15:20:38.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64c37fe640 1 -- 172.21.15.33:0/1353370001 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b4004a00 con 0x7f64cc149af0 2024-04-25T15:20:38.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.430+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64cc0a4090 con 0x7f64cc149af0 2024-04-25T15:20:38.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.431+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64cc0a3530 con 0x7f64cc149af0 2024-04-25T15:20:38.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.432+0000 7f64c37fe640 1 -- 172.21.15.33:0/1353370001 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f64b401a070 con 0x7f64cc149af0 2024-04-25T15:20:38.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.432+0000 7f64c37fe640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64ac0744b0 0x7f64ac0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.433+0000 7f64c37fe640 1 -- 172.21.15.33:0/1353370001 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f64b40943b0 con 0x7f64cc149af0 2024-04-25T15:20:38.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.433+0000 7f64caffd640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64ac0744b0 0x7f64ac0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.433+0000 7f64caffd640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64ac0744b0 0x7f64ac0769c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000f60 tx=0x7f64c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:38.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.438+0000 7f64c37fe640 1 -- 172.21.15.33:0/1353370001 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64cc0a3530 con 0x7f64cc149af0 2024-04-25T15:20:38.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.660+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64cc0764e0 con 0x7f64cc149af0 2024-04-25T15:20:38.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.661+0000 7f64c37fe640 1 -- 172.21.15.33:0/1353370001 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2213 (secure 0 0 0) 0x7f64b405ee90 con 0x7f64cc149af0 2024-04-25T15:20:38.663 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:38.663 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2065139550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2065139550},{"type":"v1","addr":"172.21.15.155:6835","nonce":2065139550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6833/23089112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":23089112},{"type":"v1","addr":"172.21.15.33:6833","nonce":23089112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T15:20:38.663 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 3 2024-04-25T15:20:38.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64ac0744b0 msgr2=0x7f64ac0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64ac0744b0 0x7f64ac0769c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000f60 tx=0x7f64c4009040 comp rx=0 tx=0).stop 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc149af0 msgr2=0x7f64cc0b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc149af0 0x7f64cc0b4c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64b400c5a0 tx=0x7f64b400ca60 comp rx=0 tx=0).stop 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 shutdown_connections 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64ac0744b0 0x7f64ac0769c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64cc0b5190 0x7f64cc0a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64cc149af0 0x7f64cc0b4c50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 --2- 172.21.15.33:0/1353370001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64cc06d230 0x7f64cc0a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 >> 172.21.15.33:0/1353370001 conn(0x7f64cc0bebf0 msgr2=0x7f64cc0bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 shutdown_connections 2024-04-25T15:20:38.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.663+0000 7f64d1540640 1 -- 172.21.15.33:0/1353370001 wait complete. 2024-04-25T15:20:38.676 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:38.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.785+0000 7f629b434640 1 Processor -- start 2024-04-25T15:20:38.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.785+0000 7f629b434640 1 -- start start 2024-04-25T15:20:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.786+0000 7f629b434640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6294149840 0x7f629406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.786+0000 7f629b434640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be0e0 0x7f62940bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.786+0000 7f629b434640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62940be4f0 0x7f629409d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.786+0000 7f629b434640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f629414a820 con 0x7f6294149840 2024-04-25T15:20:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.786+0000 7f629b434640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6294149d40 con 0x7f62940be4f0 2024-04-25T15:20:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.786+0000 7f629b434640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f629414a020 con 0x7f62940be0e0 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62991d0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6294149840 0x7f629406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62991d0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6294149840 0x7f629406d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56830/0 (socket says 172.21.15.33:56830) 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62991d0640 1 -- 172.21.15.33:0/603325444 learned_addr learned my addr 172.21.15.33:0/603325444 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62999d1640 1 --2- 172.21.15.33:0/603325444 >> v2:172.21.15.155:3300/0 conn(0x7f62940be4f0 0x7f629409d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62989cf640 1 --2- 172.21.15.33:0/603325444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be0e0 0x7f62940bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62991d0640 1 -- 172.21.15.33:0/603325444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be0e0 msgr2=0x7f62940bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62991d0640 1 --2- 172.21.15.33:0/603325444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be0e0 0x7f62940bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62991d0640 1 -- 172.21.15.33:0/603325444 >> v2:172.21.15.155:3300/0 conn(0x7f62940be4f0 msgr2=0x7f629409d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62991d0640 1 --2- 172.21.15.33:0/603325444 >> v2:172.21.15.155:3300/0 conn(0x7f62940be4f0 0x7f629409d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62991d0640 1 -- 172.21.15.33:0/603325444 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629414a300 con 0x7f6294149840 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.787+0000 7f62999d1640 1 --2- 172.21.15.33:0/603325444 >> v2:172.21.15.155:3300/0 conn(0x7f62940be4f0 0x7f629409d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f62991d0640 1 --2- 172.21.15.33:0/603325444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f629406d230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f629406e630 tx=0x7f628c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ce20051ff8245c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f6293fff640 1 -- 172.21.15.33:0/603325444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c037070 con 0x7f6294149840 2024-04-25T15:20:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f6293fff640 1 -- 172.21.15.33:0/603325444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c032440 con 0x7f6294149840 2024-04-25T15:20:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f6293fff640 1 -- 172.21.15.33:0/603325444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c032810 con 0x7f6294149840 2024-04-25T15:20:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f629b434640 1 -- 172.21.15.33:0/603325444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 msgr2=0x7f629406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f629b434640 1 --2- 172.21.15.33:0/603325444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f629406d230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f629406e630 tx=0x7f628c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f629b434640 1 -- 172.21.15.33:0/603325444 shutdown_connections 2024-04-25T15:20:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f629b434640 1 --2- 172.21.15.33:0/603325444 >> v2:172.21.15.155:3300/0 conn(0x7f62940be4f0 0x7f629409d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f629b434640 1 --2- 172.21.15.33:0/603325444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be0e0 0x7f62940bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f629b434640 1 --2- 172.21.15.33:0/603325444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f629406d230 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.788+0000 7f629b434640 1 -- 172.21.15.33:0/603325444 >> 172.21.15.33:0/603325444 conn(0x7f62940bebf0 msgr2=0x7f62940bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.789+0000 7f629b434640 1 -- 172.21.15.33:0/603325444 shutdown_connections 2024-04-25T15:20:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.789+0000 7f629b434640 1 -- 172.21.15.33:0/603325444 wait complete. 2024-04-25T15:20:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.790+0000 7f629b434640 1 Processor -- start 2024-04-25T15:20:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.790+0000 7f629b434640 1 -- start start 2024-04-25T15:20:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f629b434640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62940be0e0 0x7f62940b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f629b434640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be4f0 0x7f62940b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f629b434640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f62940b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f629b434640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f629409d920 con 0x7f6294149840 2024-04-25T15:20:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f629b434640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62940bd180 con 0x7f62940be0e0 2024-04-25T15:20:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f629b434640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f629409daa0 con 0x7f62940be4f0 2024-04-25T15:20:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62999d1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f62940b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.796 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62999d1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f62940b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56838/0 (socket says 172.21.15.33:56838) 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62999d1640 1 -- 172.21.15.33:0/3750528997 learned_addr learned my addr 172.21.15.33:0/3750528997 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62989cf640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be4f0 0x7f62940b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62991d0640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62940be0e0 0x7f62940b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62999d1640 1 -- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be4f0 msgr2=0x7f62940b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62999d1640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be4f0 0x7f62940b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62999d1640 1 -- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62940be0e0 msgr2=0x7f62940b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62999d1640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62940be0e0 0x7f62940b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.791+0000 7f62999d1640 1 -- 172.21.15.33:0/3750528997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62940b1ed0 con 0x7f6294149840 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.792+0000 7f62999d1640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f62940b3d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6284007e10 tx=0x7f628400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.792+0000 7f6291ffb640 1 -- 172.21.15.33:0/3750528997 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628401a070 con 0x7f6294149840 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.792+0000 7f6291ffb640 1 -- 172.21.15.33:0/3750528997 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6284003b90 con 0x7f6294149840 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.792+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62941df480 con 0x7f6294149840 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.792+0000 7f6291ffb640 1 -- 172.21.15.33:0/3750528997 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284004030 con 0x7f6294149840 2024-04-25T15:20:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.792+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62941dfa40 con 0x7f6294149840 2024-04-25T15:20:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.793+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62940764e0 con 0x7f6294149840 2024-04-25T15:20:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.794+0000 7f6291ffb640 1 -- 172.21.15.33:0/3750528997 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f628401d070 con 0x7f6294149840 2024-04-25T15:20:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.794+0000 7f6291ffb640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f62800744b0 0x7f62800769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.794+0000 7f6291ffb640 1 -- 172.21.15.33:0/3750528997 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6284095020 con 0x7f6294149840 2024-04-25T15:20:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.794+0000 7f62991d0640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f62800744b0 0x7f62800769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.795+0000 7f62991d0640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f62800744b0 0x7f62800769c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f628c034000 tx=0x7f628c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.799+0000 7f6291ffb640 1 -- 172.21.15.33:0/3750528997 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6284010070 con 0x7f6294149840 2024-04-25T15:20:38.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.984+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62940a1d10 con 0x7f6294149840 2024-04-25T15:20:38.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.985+0000 7f6291ffb640 1 -- 172.21.15.33:0/3750528997 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f628405fb90 con 0x7f6294149840 2024-04-25T15:20:38.986 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:38.987 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:31.840496+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f62800744b0 msgr2=0x7f62800769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f62800744b0 0x7f62800769c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f628c034000 tx=0x7f628c02e000 comp rx=0 tx=0).stop 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 msgr2=0x7f62940b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f62940b3d80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6284007e10 tx=0x7f628400d4a0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 shutdown_connections 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f62800744b0 0x7f62800769c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6294149840 0x7f62940b3d80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62940be4f0 0x7f62940b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 --2- 172.21.15.33:0/3750528997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62940be0e0 0x7f62940b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:38.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 >> 172.21.15.33:0/3750528997 conn(0x7f62940bebf0 msgr2=0x7f62940bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:38.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 shutdown_connections 2024-04-25T15:20:38.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:38.987+0000 7f629b434640 1 -- 172.21.15.33:0/3750528997 wait complete. 2024-04-25T15:20:39.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:20:29.721824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:20:39.000 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:20:39.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.113+0000 7f2d2ff9d640 1 Processor -- start 2024-04-25T15:20:39.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.113+0000 7f2d2ff9d640 1 -- start start 2024-04-25T15:20:39.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2ff9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d2806d230 0x7f2d280bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2ff9d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d28149d40 con 0x7f2d28149840 2024-04-25T15:20:39.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2ff9d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d2814a020 con 0x7f2d280bcf30 2024-04-25T15:20:39.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2ff9d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2d2814a820 con 0x7f2d2806d230 2024-04-25T15:20:39.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2dd39640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2d28149840 0x7f2d280be0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50534/0 (socket says 172.21.15.33:50534) 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2dd39640 1 -- 172.21.15.33:0/1450266184 learned_addr learned my addr 172.21.15.33:0/1450266184 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2d538640 1 --2- 172.21.15.33:0/1450266184 >> v2:172.21.15.155:3300/0 conn(0x7f2d2806d230 0x7f2d280bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2cd37640 1 -- 172.21.15.33:0/1450266184 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827871734 0 0) 0x7f2d28149d40 con 0x7f2d28149840 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.114+0000 7f2d2cd37640 1 -- 172.21.15.33:0/1450266184 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d14003520 con 0x7f2d28149840 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.115+0000 7f2d2cd37640 1 -- 172.21.15.33:0/1450266184 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888725258 0 0) 0x7f2d2814a020 con 0x7f2d280bcf30 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.115+0000 7f2d2cd37640 1 -- 172.21.15.33:0/1450266184 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d28149d40 con 0x7f2d280bcf30 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.115+0000 7f2d2d538640 1 -- 172.21.15.33:0/1450266184 >> v1:172.21.15.155:6789/0 conn(0x7f2d280bcf30 legacy=0x7f2d2809d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.115+0000 7f2d2d538640 1 -- 172.21.15.33:0/1450266184 >> v1:172.21.15.33:6789/0 conn(0x7f2d28149840 legacy=0x7f2d280be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.115+0000 7f2d2cd37640 1 -- 172.21.15.33:0/1450266184 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1318354563 0 0) 0x7f2d14003520 con 0x7f2d28149840 2024-04-25T15:20:39.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.115+0000 7f2d2d538640 1 -- 172.21.15.33:0/1450266184 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2814a300 con 0x7f2d2806d230 2024-04-25T15:20:39.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2d538640 1 --2- 172.21.15.33:0/1450266184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d2806d230 0x7f2d280bc9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d180097a0 tx=0x7f2d1802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca42f36eba1892d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2cd37640 1 -- 172.21.15.33:0/1450266184 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18037070 con 0x7f2d2806d230 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2cd37640 1 -- 172.21.15.33:0/1450266184 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1802ac50 con 0x7f2d2806d230 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2cd37640 1 -- 172.21.15.33:0/1450266184 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24001670 con 0x7f2d2806d230 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/1450266184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d2806d230 msgr2=0x7f2d280bc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2ff9d640 1 --2- 172.21.15.33:0/1450266184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d2806d230 0x7f2d280bc9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d180097a0 tx=0x7f2d1802a1c0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/1450266184 shutdown_connections 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2ff9d640 1 --2- 172.21.15.33:0/1450266184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d2806d230 0x7f2d280bc9f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.116+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/1450266184 >> 172.21.15.33:0/1450266184 conn(0x7f2d280bebf0 msgr2=0x7f2d280bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.117+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/1450266184 shutdown_connections 2024-04-25T15:20:39.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.117+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/1450266184 wait complete. 2024-04-25T15:20:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.118+0000 7f2d2ff9d640 1 Processor -- start 2024-04-25T15:20:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.118+0000 7f2d2ff9d640 1 -- start start 2024-04-25T15:20:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2ff9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d2806d230 0x7f2d280b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2ff9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d280bcf30 0x7f2d280a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2ff9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d28149840 0x7f2d280a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2ff9d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2809dc70 con 0x7f2d28149840 2024-04-25T15:20:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2ff9d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2809daf0 con 0x7f2d280bcf30 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2ff9d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d280a27c0 con 0x7f2d2806d230 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2e53a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d28149840 0x7f2d280a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2e53a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d28149840 0x7f2d280a2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56840/0 (socket says 172.21.15.33:56840) 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2e53a640 1 -- 172.21.15.33:0/2221134441 learned_addr learned my addr 172.21.15.33:0/2221134441 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2d538640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d280bcf30 0x7f2d280a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.119+0000 7f2d2dd39640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d2806d230 0x7f2d280b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d2e53a640 1 -- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d2806d230 msgr2=0x7f2d280b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d2e53a640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d2806d230 0x7f2d280b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d2e53a640 1 -- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d280bcf30 msgr2=0x7f2d280a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d2e53a640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d280bcf30 0x7f2d280a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d2e53a640 1 -- 172.21.15.33:0/2221134441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d28154bf0 con 0x7f2d28149840 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d2e53a640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d28149840 0x7f2d280a2ca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000c6b0 tx=0x7f2d2000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d1e7fc640 1 -- 172.21.15.33:0/2221134441 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20003b70 con 0x7f2d28149840 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d1e7fc640 1 -- 172.21.15.33:0/2221134441 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d20003d10 con 0x7f2d28149840 2024-04-25T15:20:39.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d280a22f0 con 0x7f2d28149840 2024-04-25T15:20:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d1e7fc640 1 -- 172.21.15.33:0/2221134441 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20005310 con 0x7f2d28149840 2024-04-25T15:20:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.120+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d280a4450 con 0x7f2d28149840 2024-04-25T15:20:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.121+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d280b28c0 con 0x7f2d28149840 2024-04-25T15:20:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.122+0000 7f2d1e7fc640 1 -- 172.21.15.33:0/2221134441 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2d200054b0 con 0x7f2d28149840 2024-04-25T15:20:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.122+0000 7f2d1e7fc640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2d0c0744b0 0x7f2d0c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.122+0000 7f2d1e7fc640 1 -- 172.21.15.33:0/2221134441 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2d20094cd0 con 0x7f2d28149840 2024-04-25T15:20:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.122+0000 7f2d2dd39640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2d0c0744b0 0x7f2d0c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.123+0000 7f2d2dd39640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2d0c0744b0 0x7f2d0c0769c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d240017e0 tx=0x7f2d24001610 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.127+0000 7f2d1e7fc640 1 -- 172.21.15.33:0/2221134441 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d2005f170 con 0x7f2d28149840 2024-04-25T15:20:39.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.313+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d2809cea0 con 0x7f2d28149840 2024-04-25T15:20:39.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.313+0000 7f2d1e7fc640 1 -- 172.21.15.33:0/2221134441 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f2d20063470 con 0x7f2d28149840 2024-04-25T15:20:39.315 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-04-25T15:20:39.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2d0c0744b0 msgr2=0x7f2d0c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2d0c0744b0 0x7f2d0c0769c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d240017e0 tx=0x7f2d24001610 comp rx=0 tx=0).stop 2024-04-25T15:20:39.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d28149840 msgr2=0x7f2d280a2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d28149840 0x7f2d280a2ca0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000c6b0 tx=0x7f2d2000cb70 comp rx=0 tx=0).stop 2024-04-25T15:20:39.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 shutdown_connections 2024-04-25T15:20:39.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2d0c0744b0 0x7f2d0c0769c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d28149840 0x7f2d280a2ca0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d280bcf30 0x7f2d280a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 --2- 172.21.15.33:0/2221134441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d2806d230 0x7f2d280b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 >> 172.21.15.33:0/2221134441 conn(0x7f2d280bebf0 msgr2=0x7f2d281477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:39.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 shutdown_connections 2024-04-25T15:20:39.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.315+0000 7f2d2ff9d640 1 -- 172.21.15.33:0/2221134441 wait complete. 2024-04-25T15:20:39.328 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T15:20:39.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.437+0000 7f9f519ce640 1 Processor -- start 2024-04-25T15:20:39.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.437+0000 7f9f519ce640 1 -- start start 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.438+0000 7f9f519ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c06d230 0x7f9f4c0bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.438+0000 7f9f519ce640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4c149d40 con 0x7f9f4c149840 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.438+0000 7f9f519ce640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4c14a020 con 0x7f9f4c0bcf30 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.438+0000 7f9f519ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c14a820 con 0x7f9f4c06d230 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.438+0000 7f9f4affd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9f4c149840 0x7f9f4c0be0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50536/0 (socket says 172.21.15.33:50536) 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.438+0000 7f9f4affd640 1 -- 172.21.15.33:0/2809076357 learned_addr learned my addr 172.21.15.33:0/2809076357 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f4a7fc640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c06d230 0x7f9f4c0bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240384098 0 0) 0x7f9f4c149d40 con 0x7f9f4c149840 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f38003520 con 0x7f9f4c149840 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3084115646 0 0) 0x7f9f38003520 con 0x7f9f4c149840 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c06d230 msgr2=0x7f9f4c0bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c06d230 0x7f9f4c0bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 >> v1:172.21.15.155:6789/0 conn(0x7f9f4c0bcf30 legacy=0x7f9f4c09d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c14a300 con 0x7f9f4c149840 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7f9f44001670 con 0x7f9f4c149840 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 >> v1:172.21.15.33:6789/0 conn(0x7f9f4c149840 legacy=0x7f9f4c0be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c06d230 0x7f9f380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f38003f40 0x7f9f38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f38004d40 0x7f9f38005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c14a820 con 0x7f9f38003f40 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3800bad0 con 0x7f9f38004d40 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3800bcd0 con 0x7f9f4c06d230 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f4a7fc640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f38003f40 0x7f9f38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f4affd640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c06d230 0x7f9f380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.439+0000 7f9f4b7fe640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f38004d40 0x7f9f38005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f4a7fc640 1 -- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c06d230 msgr2=0x7f9f380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f4a7fc640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c06d230 0x7f9f380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f4a7fc640 1 -- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f38004d40 msgr2=0x7f9f38005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f4a7fc640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f38004d40 0x7f9f38005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f4a7fc640 1 -- 172.21.15.33:0/2809076357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f38003520 con 0x7f9f38003f40 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f4b7fe640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f38004d40 0x7f9f38005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f4a7fc640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f38003f40 0x7f9f38004800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009a90 tx=0x7f9f38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54975a2de71e5cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34036070 con 0x7f9f38003f40 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f34031400 con 0x7f9f38003f40 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.440+0000 7f9f49ffb640 1 -- 172.21.15.33:0/2809076357 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34009690 con 0x7f9f38003f40 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.441+0000 7f9f519ce640 1 -- 172.21.15.33:0/2809076357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f38003f40 msgr2=0x7f9f38004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.441+0000 7f9f519ce640 1 --2- 172.21.15.33:0/2809076357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f38003f40 0x7f9f38004800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009a90 tx=0x7f9f38005830 comp rx=0 tx=0).stop 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.441+0000 7f9f4b7fe640 1 -- 172.21.15.33:0/2809076357 reap_dead start 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.441+0000 7f9f519ce640 1 -- 172.21.15.33:0/2809076357 shutdown_connections 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.441+0000 7f9f519ce640 1 -- 172.21.15.33:0/2809076357 >> 172.21.15.33:0/2809076357 conn(0x7f9f4c0bebf0 msgr2=0x7f9f4c0bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.441+0000 7f9f519ce640 1 -- 172.21.15.33:0/2809076357 shutdown_connections 2024-04-25T15:20:39.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.441+0000 7f9f519ce640 1 -- 172.21.15.33:0/2809076357 wait complete. 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.443+0000 7f9f519ce640 1 Processor -- start 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.443+0000 7f9f519ce640 1 -- start start 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f519ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f38003f40 0x7f9f4c0a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f519ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f4c1df660 0x7f9f4c0a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f519ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c0a3050 0x7f9f4c1e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f519ce640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c09dc70 con 0x7f9f4c1df660 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f519ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c09daf0 con 0x7f9f4c0a3050 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f519ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c0a2750 con 0x7f9f38003f40 2024-04-25T15:20:39.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f4c1df660 0x7f9f4c0a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f4c1df660 0x7f9f4c0a2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56862/0 (socket says 172.21.15.33:56862) 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 -- 172.21.15.33:0/1003637979 learned_addr learned my addr 172.21.15.33:0/1003637979 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4affd640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f38003f40 0x7f9f4c0a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4b7fe640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c0a3050 0x7f9f4c1e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 -- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f38003f40 msgr2=0x7f9f4c0a4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f38003f40 0x7f9f4c0a4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 -- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c0a3050 msgr2=0x7f9f4c1e23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c0a3050 0x7f9f4c1e23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 -- 172.21.15.33:0/1003637979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c0b65c0 con 0x7f9f4c1df660 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.444+0000 7f9f4a7fc640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f4c1df660 0x7f9f4c0a2b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009bb0 tx=0x7f9f34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.445+0000 7f9f43fff640 1 -- 172.21.15.33:0/1003637979 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34040020 con 0x7f9f4c1df660 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.445+0000 7f9f43fff640 1 -- 172.21.15.33:0/1003637979 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f34003a40 con 0x7f9f4c1df660 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.445+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c0a3c70 con 0x7f9f4c1df660 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.445+0000 7f9f43fff640 1 -- 172.21.15.33:0/1003637979 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34036040 con 0x7f9f4c1df660 2024-04-25T15:20:39.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.445+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c1dfdb0 con 0x7f9f4c1df660 2024-04-25T15:20:39.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.446+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f4c0764e0 con 0x7f9f4c1df660 2024-04-25T15:20:39.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.446+0000 7f9f43fff640 1 -- 172.21.15.33:0/1003637979 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9f34043020 con 0x7f9f4c1df660 2024-04-25T15:20:39.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.447+0000 7f9f43fff640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9f2c0744e0 0x7f9f2c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.447+0000 7f9f43fff640 1 -- 172.21.15.33:0/1003637979 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9f340b5190 con 0x7f9f4c1df660 2024-04-25T15:20:39.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.447+0000 7f9f4affd640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9f2c0744e0 0x7f9f2c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.448+0000 7f9f4affd640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9f2c0744e0 0x7f9f2c0769f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f44001050 tx=0x7f9f44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.451+0000 7f9f43fff640 1 -- 172.21.15.33:0/1003637979 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9f3404a070 con 0x7f9f4c1df660 2024-04-25T15:20:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.637+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9f4c0a4950 con 0x7f9f4c1df660 2024-04-25T15:20:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.638+0000 7f9f43fff640 1 -- 172.21.15.33:0/1003637979 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f9f3407fc70 con 0x7f9f4c1df660 2024-04-25T15:20:39.639 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:39.639 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-04-25T15:20:39.639 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:20:39.640 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-04-25T15:20:39.640 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-04-25T15:20:39.640 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:20:39.640 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-04-25T15:20:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9f2c0744e0 msgr2=0x7f9f2c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9f2c0744e0 0x7f9f2c0769f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f44001050 tx=0x7f9f44009040 comp rx=0 tx=0).stop 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f4c1df660 msgr2=0x7f9f4c0a2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f4c1df660 0x7f9f4c0a2b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009bb0 tx=0x7f9f34004730 comp rx=0 tx=0).stop 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 shutdown_connections 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9f2c0744e0 0x7f9f2c0769f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c0a3050 0x7f9f4c1e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f4c1df660 0x7f9f4c0a2b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 --2- 172.21.15.33:0/1003637979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f38003f40 0x7f9f4c0a4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 >> 172.21.15.33:0/1003637979 conn(0x7f9f4c0bebf0 msgr2=0x7f9f4c148c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 shutdown_connections 2024-04-25T15:20:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.640+0000 7f9f519ce640 1 -- 172.21.15.33:0/1003637979 wait complete. 2024-04-25T15:20:39.652 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T15:20:39.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T15:20:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.766+0000 7fc6763ce640 1 Processor -- start 2024-04-25T15:20:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.766+0000 7fc6763ce640 1 -- start start 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc6763ce640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc6700b3770 0x7fc6700b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc6763ce640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6700b4050 con 0x7fc6700b91f0 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc6763ce640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6700b42f0 con 0x7fc670141530 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc6763ce640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fc6700b4a60 con 0x7fc6700b3770 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc66ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc6700b3770 0x7fc6700b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc66f7fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc6700b91f0 0x7fc6700b6750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50542/0 (socket says 172.21.15.33:50542) 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc66f7fe640 1 -- 172.21.15.33:0/4009195039 learned_addr learned my addr 172.21.15.33:0/4009195039 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc66ffff640 1 -- 172.21.15.33:0/4009195039 >> v1:172.21.15.155:6789/0 conn(0x7fc670141530 legacy=0x7fc670141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:39.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc66ffff640 1 -- 172.21.15.33:0/4009195039 >> v1:172.21.15.33:6789/0 conn(0x7fc6700b91f0 legacy=0x7fc6700b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc66effd640 1 -- 172.21.15.33:0/4009195039 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924903146 0 0) 0x7fc6700b4050 con 0x7fc6700b91f0 2024-04-25T15:20:39.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.767+0000 7fc66ffff640 1 -- 172.21.15.33:0/4009195039 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6700b9600 con 0x7fc6700b3770 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.768+0000 7fc66ffff640 1 --2- 172.21.15.33:0/4009195039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6700b3770 0x7fc6700b51d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc6600097a0 tx=0x7fc66002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1839cbd694040a01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.768+0000 7fc66effd640 1 -- 172.21.15.33:0/4009195039 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660037070 con 0x7fc6700b3770 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.768+0000 7fc66effd640 1 -- 172.21.15.33:0/4009195039 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66002adc0 con 0x7fc6700b3770 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.768+0000 7fc66effd640 1 -- 172.21.15.33:0/4009195039 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660032660 con 0x7fc6700b3770 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.769+0000 7fc6763ce640 1 -- 172.21.15.33:0/4009195039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6700b3770 msgr2=0x7fc6700b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.769+0000 7fc6763ce640 1 --2- 172.21.15.33:0/4009195039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6700b3770 0x7fc6700b51d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc6600097a0 tx=0x7fc66002a0b0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.769+0000 7fc6763ce640 1 -- 172.21.15.33:0/4009195039 shutdown_connections 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.769+0000 7fc6763ce640 1 --2- 172.21.15.33:0/4009195039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6700b3770 0x7fc6700b51d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.769+0000 7fc6763ce640 1 -- 172.21.15.33:0/4009195039 >> 172.21.15.33:0/4009195039 conn(0x7fc670074060 msgr2=0x7fc67006c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.769+0000 7fc6763ce640 1 -- 172.21.15.33:0/4009195039 shutdown_connections 2024-04-25T15:20:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.769+0000 7fc6763ce640 1 -- 172.21.15.33:0/4009195039 wait complete. 2024-04-25T15:20:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.770+0000 7fc6763ce640 1 Processor -- start 2024-04-25T15:20:39.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.771+0000 7fc6763ce640 1 -- start start 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc6763ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6700b3770 0x7fc6701403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc6763ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6700b91f0 0x7fc670132010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc6763ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc670141530 0x7fc6701e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc6763ce640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700b3b80 con 0x7fc670141530 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc6763ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6700b4d40 con 0x7fc6700b91f0 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc6763ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc670153110 con 0x7fc6700b3770 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc670141530 0x7fc6701e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc670141530 0x7fc6701e2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56878/0 (socket says 172.21.15.33:56878) 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 -- 172.21.15.33:0/351977982 learned_addr learned my addr 172.21.15.33:0/351977982 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:39.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc66ffff640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6700b3770 0x7fc6701403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc66f7fe640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6700b91f0 0x7fc670132010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 -- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6700b3770 msgr2=0x7fc6701403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6700b3770 0x7fc6701403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 -- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6700b91f0 msgr2=0x7fc670132010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6700b91f0 0x7fc670132010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 -- 172.21.15.33:0/351977982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67006f6f0 con 0x7fc670141530 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc67496b640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc670141530 0x7fc6701e2d70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc66800ba10 tx=0x7fc66800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.772+0000 7fc66cff9640 1 -- 172.21.15.33:0/351977982 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668019070 con 0x7fc670141530 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.773+0000 7fc66cff9640 1 -- 172.21.15.33:0/351977982 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66800cb40 con 0x7fc670141530 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.773+0000 7fc66cff9640 1 -- 172.21.15.33:0/351977982 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668014440 con 0x7fc670141530 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.773+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc670132550 con 0x7fc670141530 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.773+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc670140ed0 con 0x7fc670141530 2024-04-25T15:20:39.776 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.774+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6700745b0 con 0x7fc670141530 2024-04-25T15:20:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.774+0000 7fc66cff9640 1 -- 172.21.15.33:0/351977982 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc66801c070 con 0x7fc670141530 2024-04-25T15:20:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.775+0000 7fc66cff9640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc65c0744e0 0x7fc65c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.775+0000 7fc66cff9640 1 -- 172.21.15.33:0/351977982 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc668094920 con 0x7fc670141530 2024-04-25T15:20:39.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.775+0000 7fc66ffff640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc65c0744e0 0x7fc65c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:39.778 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.776+0000 7fc66ffff640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc65c0744e0 0x7fc65c0769f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc660034000 tx=0x7fc66002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:39.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.779+0000 7fc66cff9640 1 -- 172.21.15.33:0/351977982 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc6700745b0 con 0x7fc670141530 2024-04-25T15:20:39.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:39.963+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc67006f500 con 0x7fc670141530 2024-04-25T15:20:40.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.381+0000 7fc66cff9640 1 -- 172.21.15.33:0/351977982 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fc66805eed0 con 0x7fc670141530 2024-04-25T15:20:40.383 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-04-25T15:20:40.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc65c0744e0 msgr2=0x7fc65c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:40.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc65c0744e0 0x7fc65c0769f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc660034000 tx=0x7fc66002e000 comp rx=0 tx=0).stop 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc670141530 msgr2=0x7fc6701e2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc670141530 0x7fc6701e2d70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc66800ba10 tx=0x7fc66800bed0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 shutdown_connections 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc65c0744e0 0x7fc65c0769f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc670141530 0x7fc6701e2d70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6700b91f0 0x7fc670132010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 --2- 172.21.15.33:0/351977982 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6700b3770 0x7fc6701403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 >> 172.21.15.33:0/351977982 conn(0x7fc670074060 msgr2=0x7fc6700bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 shutdown_connections 2024-04-25T15:20:40.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.384+0000 7fc6763ce640 1 -- 172.21.15.33:0/351977982 wait complete. 2024-04-25T15:20:40.403 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T15:20:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.523+0000 7f257e338640 1 Processor -- start 2024-04-25T15:20:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.523+0000 7f257e338640 1 -- start start 2024-04-25T15:20:40.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f257e338640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25780b9570 0x7f257806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:40.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f257e338640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f25780ba490 0x7f25780be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f257e338640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25780b99b0 con 0x7f257814cd40 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f257e338640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f25780b9c90 con 0x7f25780ba490 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f257e338640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25780b9f70 con 0x7f25780b9570 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f25777fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f25780ba490 0x7f25780be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f25777fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f25780ba490 0x7f25780be070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56888/0 (socket says 172.21.15.33:56888) 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f25777fe640 1 -- 172.21.15.33:0/246029549 learned_addr learned my addr 172.21.15.33:0/246029549 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f257c8d5640 1 --1- 172.21.15.33:0/246029549 >> v1:172.21.15.33:6789/0 conn(0x7f257814cd40 0x7f257809d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50554/0 (socket says 172.21.15.33:50554) 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f2577fff640 1 --2- 172.21.15.33:0/246029549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25780b9570 0x7f257806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f25777fe640 1 -- 172.21.15.33:0/246029549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25780b9570 msgr2=0x7f257806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f25777fe640 1 --2- 172.21.15.33:0/246029549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25780b9570 0x7f257806d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f25777fe640 1 -- 172.21.15.33:0/246029549 >> v1:172.21.15.33:6789/0 conn(0x7f257814cd40 legacy=0x7f257809d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f25777fe640 1 -- 172.21.15.33:0/246029549 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25780be5b0 con 0x7f25780ba490 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.524+0000 7f2576ffd640 1 -- 172.21.15.33:0/246029549 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645993030 0 0) 0x7f25780b99b0 con 0x7f257814cd40 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.525+0000 7f25777fe640 1 --2- 172.21.15.33:0/246029549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780ba490 0x7f25780be070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2560009870 tx=0x7f256002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208045fd88e5986a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.525+0000 7f2576ffd640 1 -- 172.21.15.33:0/246029549 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560037070 con 0x7f25780ba490 2024-04-25T15:20:40.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.525+0000 7f2576ffd640 1 -- 172.21.15.33:0/246029549 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2560032440 con 0x7f25780ba490 2024-04-25T15:20:40.528 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.525+0000 7f2576ffd640 1 -- 172.21.15.33:0/246029549 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560032810 con 0x7f25780ba490 2024-04-25T15:20:40.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.526+0000 7f257e338640 1 -- 172.21.15.33:0/246029549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780ba490 msgr2=0x7f25780be070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:40.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.526+0000 7f257e338640 1 --2- 172.21.15.33:0/246029549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780ba490 0x7f25780be070 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2560009870 tx=0x7f256002a270 comp rx=0 tx=0).stop 2024-04-25T15:20:40.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.526+0000 7f257e338640 1 -- 172.21.15.33:0/246029549 shutdown_connections 2024-04-25T15:20:40.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.526+0000 7f257e338640 1 --2- 172.21.15.33:0/246029549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780ba490 0x7f25780be070 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.526+0000 7f257e338640 1 --2- 172.21.15.33:0/246029549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25780b9570 0x7f257806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.526+0000 7f257e338640 1 -- 172.21.15.33:0/246029549 >> 172.21.15.33:0/246029549 conn(0x7f25780bebf0 msgr2=0x7f25780bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:40.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.526+0000 7f257e338640 1 -- 172.21.15.33:0/246029549 shutdown_connections 2024-04-25T15:20:40.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.526+0000 7f257e338640 1 -- 172.21.15.33:0/246029549 wait complete. 2024-04-25T15:20:40.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.527+0000 7f257e338640 1 Processor -- start 2024-04-25T15:20:40.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.528+0000 7f257e338640 1 -- start start 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257e338640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f257814cd40 0x7f25780a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257e338640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2578149920 0x7f25780a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257e338640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780a3eb0 0x7f25780a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257e338640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f257814d2d0 con 0x7f25780a3eb0 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257e338640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f257814d150 con 0x7f257814cd40 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257e338640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25781540b0 con 0x7f2578149920 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780a3eb0 0x7f25780a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780a3eb0 0x7f25780a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56904/0 (socket says 172.21.15.33:56904) 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 -- 172.21.15.33:0/4050236610 learned_addr learned my addr 172.21.15.33:0/4050236610 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f25777fe640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2578149920 0x7f25780a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f2577fff640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f257814cd40 0x7f25780a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 -- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2578149920 msgr2=0x7f25780a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:40.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2578149920 0x7f25780a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 -- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f257814cd40 msgr2=0x7f25780a24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f257814cd40 0x7f25780a24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 -- 172.21.15.33:0/4050236610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2578146c90 con 0x7f25780a3eb0 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257c8d5640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780a3eb0 0x7f25780a42c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f257000c730 tx=0x7f257000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f2574ff9640 1 -- 172.21.15.33:0/4050236610 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570018070 con 0x7f25780a3eb0 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f2574ff9640 1 -- 172.21.15.33:0/4050236610 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f257000ce40 con 0x7f25780a3eb0 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.529+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2578146f70 con 0x7f25780a3eb0 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.530+0000 7f2574ff9640 1 -- 172.21.15.33:0/4050236610 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257000a860 con 0x7f25780a3eb0 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.530+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2578149d30 con 0x7f25780a3eb0 2024-04-25T15:20:40.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.530+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25780a1bc0 con 0x7f25780a3eb0 2024-04-25T15:20:40.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.531+0000 7f2574ff9640 1 -- 172.21.15.33:0/4050236610 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f257001b070 con 0x7f25780a3eb0 2024-04-25T15:20:40.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.532+0000 7f2574ff9640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f25580744e0 0x7f25580769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:40.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.532+0000 7f2574ff9640 1 -- 172.21.15.33:0/4050236610 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f2570094500 con 0x7f25780a3eb0 2024-04-25T15:20:40.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.532+0000 7f2577fff640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f25580744e0 0x7f25580769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:40.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.533+0000 7f2577fff640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f25580744e0 0x7f25580769f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257814a900 tx=0x7f2568008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:40.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.537+0000 7f2574ff9640 1 -- 172.21.15.33:0/4050236610 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f257005e8b0 con 0x7f25780a3eb0 2024-04-25T15:20:40.722 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:40.721+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f25780a20c0 con 0x7f25780a3eb0 2024-04-25T15:20:41.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.384+0000 7f2574ff9640 1 -- 172.21.15.33:0/4050236610 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f2570062bb0 con 0x7f25780a3eb0 2024-04-25T15:20:41.386 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-04-25T15:20:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f25580744e0 msgr2=0x7f25580769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f25580744e0 0x7f25580769f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f257814a900 tx=0x7f2568008040 comp rx=0 tx=0).stop 2024-04-25T15:20:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780a3eb0 msgr2=0x7f25780a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780a3eb0 0x7f25780a42c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f257000c730 tx=0x7f257000cbf0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 shutdown_connections 2024-04-25T15:20:41.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f25580744e0 0x7f25580769f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25780a3eb0 0x7f25780a42c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2578149920 0x7f25780a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 --2- 172.21.15.33:0/4050236610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f257814cd40 0x7f25780a24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.387+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 >> 172.21.15.33:0/4050236610 conn(0x7f25780bebf0 msgr2=0x7f25780bbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.388+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 shutdown_connections 2024-04-25T15:20:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.388+0000 7f257e338640 1 -- 172.21.15.33:0/4050236610 wait complete. 2024-04-25T15:20:41.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T15:20:41.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.541+0000 7f3141484640 1 Processor -- start 2024-04-25T15:20:41.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.541+0000 7f3141484640 1 -- start start 2024-04-25T15:20:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.542+0000 7f3141484640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f313c0bd100 0x7f313c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.542+0000 7f3141484640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f313c1497d0 0x7f313c09d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.542+0000 7f3141484640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313c149e40 con 0x7f313c0bdbb0 2024-04-25T15:20:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.542+0000 7f3141484640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f313c14a490 con 0x7f313c1497d0 2024-04-25T15:20:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.542+0000 7f3141484640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f313c0bdfc0 con 0x7f313c0bd100 2024-04-25T15:20:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.542+0000 7f313affd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f313c0bdbb0 0x7f313c0bc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50556/0 (socket says 172.21.15.33:50556) 2024-04-25T15:20:41.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.542+0000 7f313b7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f313c1497d0 0x7f313c09d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:41.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.542+0000 7f313affd640 1 -- 172.21.15.33:0/728327902 learned_addr learned my addr 172.21.15.33:0/728327902 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:41.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.543+0000 7f313a7fc640 1 --2- 172.21.15.33:0/728327902 >> v2:172.21.15.155:3300/0 conn(0x7f313c0bd100 0x7f313c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:41.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.543+0000 7f313b7fe640 1 -- 172.21.15.33:0/728327902 >> v2:172.21.15.155:3300/0 conn(0x7f313c0bd100 msgr2=0x7f313c06d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:41.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.543+0000 7f313b7fe640 1 --2- 172.21.15.33:0/728327902 >> v2:172.21.15.155:3300/0 conn(0x7f313c0bd100 0x7f313c06d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.543+0000 7f313b7fe640 1 -- 172.21.15.33:0/728327902 >> v1:172.21.15.33:6789/0 conn(0x7f313c0bdbb0 legacy=0x7f313c0bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:41.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.543+0000 7f313b7fe640 1 -- 172.21.15.33:0/728327902 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c14a120 con 0x7f313c1497d0 2024-04-25T15:20:41.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.543+0000 7f3139ffb640 1 -- 172.21.15.33:0/728327902 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961019781 0 0) 0x7f313c149e40 con 0x7f313c0bdbb0 2024-04-25T15:20:41.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.543+0000 7f313b7fe640 1 --2- 172.21.15.33:0/728327902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c1497d0 0x7f313c09d3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f313c0bd510 tx=0x7f313402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526386963ea5461d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:41.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.543+0000 7f3139ffb640 1 -- 172.21.15.33:0/728327902 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134007740 con 0x7f313c1497d0 2024-04-25T15:20:41.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3139ffb640 1 -- 172.21.15.33:0/728327902 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31340078e0 con 0x7f313c1497d0 2024-04-25T15:20:41.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3139ffb640 1 -- 172.21.15.33:0/728327902 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134007cb0 con 0x7f313c1497d0 2024-04-25T15:20:41.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3141484640 1 -- 172.21.15.33:0/728327902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c1497d0 msgr2=0x7f313c09d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:41.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3141484640 1 --2- 172.21.15.33:0/728327902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c1497d0 0x7f313c09d3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f313c0bd510 tx=0x7f313402a5f0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3141484640 1 -- 172.21.15.33:0/728327902 shutdown_connections 2024-04-25T15:20:41.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3141484640 1 --2- 172.21.15.33:0/728327902 >> v2:172.21.15.155:3300/0 conn(0x7f313c0bd100 0x7f313c06d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3141484640 1 --2- 172.21.15.33:0/728327902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c1497d0 0x7f313c09d3e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3141484640 1 -- 172.21.15.33:0/728327902 >> 172.21.15.33:0/728327902 conn(0x7f313c0bedd0 msgr2=0x7f313c0bf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:41.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3141484640 1 -- 172.21.15.33:0/728327902 shutdown_connections 2024-04-25T15:20:41.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.544+0000 7f3141484640 1 -- 172.21.15.33:0/728327902 wait complete. 2024-04-25T15:20:41.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.546+0000 7f3141484640 1 Processor -- start 2024-04-25T15:20:41.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.546+0000 7f3141484640 1 -- start start 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f3141484640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0bd100 0x7f313c0b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f3141484640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c0bdbb0 0x7f313c1df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f3141484640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f313c1497d0 0x7f313c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f3141484640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f313c09dcb0 con 0x7f313c0bdbb0 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f3141484640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f313c09db30 con 0x7f313c0bd100 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f3141484640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f313c149be0 con 0x7f313c1497d0 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c0bdbb0 0x7f313c1df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313a7fc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c0bdbb0 0x7f313c1df8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56912/0 (socket says 172.21.15.33:56912) 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313a7fc640 1 -- 172.21.15.33:0/545234686 learned_addr learned my addr 172.21.15.33:0/545234686 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313affd640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0bd100 0x7f313c0b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313b7fe640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f313c1497d0 0x7f313c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313a7fc640 1 -- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f313c1497d0 msgr2=0x7f313c146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:41.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313a7fc640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f313c1497d0 0x7f313c146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313a7fc640 1 -- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0bd100 msgr2=0x7f313c0b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313a7fc640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0bd100 0x7f313c0b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313a7fc640 1 -- 172.21.15.33:0/545234686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c1dfde0 con 0x7f313c0bdbb0 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.547+0000 7f313affd640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0bd100 0x7f313c0b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.548+0000 7f313a7fc640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c0bdbb0 0x7f313c1df8a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f313000c7f0 tx=0x7f313000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.548+0000 7f31237fe640 1 -- 172.21.15.33:0/545234686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130015070 con 0x7f313c0bdbb0 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.548+0000 7f31237fe640 1 -- 172.21.15.33:0/545234686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130007820 con 0x7f313c0bdbb0 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.548+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313c0b4ad0 con 0x7f313c0bdbb0 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.548+0000 7f31237fe640 1 -- 172.21.15.33:0/545234686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130007bd0 con 0x7f313c0bdbb0 2024-04-25T15:20:41.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.548+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313c1dfff0 con 0x7f313c0bdbb0 2024-04-25T15:20:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.549+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313c06d690 con 0x7f313c0bdbb0 2024-04-25T15:20:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.549+0000 7f31237fe640 1 -- 172.21.15.33:0/545234686 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3130018070 con 0x7f313c0bdbb0 2024-04-25T15:20:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.550+0000 7f31237fe640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f31280744b0 0x7f31280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.550+0000 7f31237fe640 1 -- 172.21.15.33:0/545234686 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f3130094ec0 con 0x7f313c0bdbb0 2024-04-25T15:20:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.550+0000 7f313affd640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f31280744b0 0x7f31280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.551+0000 7f313affd640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f31280744b0 0x7f31280769c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f312c000f60 tx=0x7f312c007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:41.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.555+0000 7f31237fe640 1 -- 172.21.15.33:0/545234686 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f313005f740 con 0x7f313c0bdbb0 2024-04-25T15:20:41.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:41.779+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f313c149300 con 0x7f313c0bdbb0 2024-04-25T15:20:42.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.412+0000 7f31237fe640 1 -- 172.21.15.33:0/545234686 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f313005f040 con 0x7f313c0bdbb0 2024-04-25T15:20:42.414 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T15:20:42.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.421+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f31280744b0 msgr2=0x7f31280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.421+0000 7f3141484640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f31280744b0 0x7f31280769c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f312c000f60 tx=0x7f312c007ca0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.421+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c0bdbb0 msgr2=0x7f313c1df8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.421+0000 7f3141484640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c0bdbb0 0x7f313c1df8a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f313000c7f0 tx=0x7f313000ccb0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.422+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 shutdown_connections 2024-04-25T15:20:42.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.422+0000 7f3141484640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f31280744b0 0x7f31280769c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.422+0000 7f3141484640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f313c1497d0 0x7f313c146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.422+0000 7f3141484640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f313c0bdbb0 0x7f313c1df8a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.422+0000 7f3141484640 1 --2- 172.21.15.33:0/545234686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f313c0bd100 0x7f313c0b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.422+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 >> 172.21.15.33:0/545234686 conn(0x7f313c0bedd0 msgr2=0x7f313c09c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:42.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.423+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 shutdown_connections 2024-04-25T15:20:42.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.423+0000 7f3141484640 1 -- 172.21.15.33:0/545234686 wait complete. 2024-04-25T15:20:42.447 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:42.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.562+0000 7f70746d8640 1 Processor -- start 2024-04-25T15:20:42.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.562+0000 7f70746d8640 1 -- start start 2024-04-25T15:20:42.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.563+0000 7f70746d8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f706c09d3e0 0x7f706c09d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.563+0000 7f70746d8640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706c149d40 con 0x7f706c06d230 2024-04-25T15:20:42.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.563+0000 7f70746d8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706c14a020 con 0x7f706c149840 2024-04-25T15:20:42.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.563+0000 7f70746d8640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f706c14a820 con 0x7f706c09d3e0 2024-04-25T15:20:42.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.563+0000 7f7071c73640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f706c06d230 0x7f706c0bc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50568/0 (socket says 172.21.15.33:50568) 2024-04-25T15:20:42.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.563+0000 7f7071c73640 1 -- 172.21.15.33:0/3814377421 learned_addr learned my addr 172.21.15.33:0/3814377421 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:42.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.563+0000 7f7072c75640 1 --2- 172.21.15.33:0/3814377421 >> v2:172.21.15.155:3300/0 conn(0x7f706c09d3e0 0x7f706c09d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.564+0000 7f7071472640 1 -- 172.21.15.33:0/3814377421 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268856696 0 0) 0x7f706c149d40 con 0x7f706c06d230 2024-04-25T15:20:42.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.564+0000 7f7071472640 1 -- 172.21.15.33:0/3814377421 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7058003520 con 0x7f706c06d230 2024-04-25T15:20:42.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.564+0000 7f7072c75640 1 -- 172.21.15.33:0/3814377421 >> v1:172.21.15.155:6789/0 conn(0x7f706c149840 legacy=0x7f706c0be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.564+0000 7f7071472640 1 -- 172.21.15.33:0/3814377421 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993948024 0 0) 0x7f706c14a020 con 0x7f706c149840 2024-04-25T15:20:42.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.564+0000 7f7072c75640 1 -- 172.21.15.33:0/3814377421 >> v1:172.21.15.33:6789/0 conn(0x7f706c06d230 legacy=0x7f706c0bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.564+0000 7f7072c75640 1 -- 172.21.15.33:0/3814377421 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c14a300 con 0x7f706c09d3e0 2024-04-25T15:20:42.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f7072c75640 1 --2- 172.21.15.33:0/3814377421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 0x7f706c09d7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7064009d90 tx=0x7f706402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd01586a92a5c31e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:42.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f7071472640 1 -- 172.21.15.33:0/3814377421 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7064007740 con 0x7f706c09d3e0 2024-04-25T15:20:42.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f7071472640 1 -- 172.21.15.33:0/3814377421 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70640078e0 con 0x7f706c09d3e0 2024-04-25T15:20:42.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f7071472640 1 -- 172.21.15.33:0/3814377421 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7064007cb0 con 0x7f706c09d3e0 2024-04-25T15:20:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f70746d8640 1 -- 172.21.15.33:0/3814377421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 msgr2=0x7f706c09d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f70746d8640 1 --2- 172.21.15.33:0/3814377421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 0x7f706c09d7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7064009d90 tx=0x7f706402a6f0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f70746d8640 1 -- 172.21.15.33:0/3814377421 shutdown_connections 2024-04-25T15:20:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f70746d8640 1 --2- 172.21.15.33:0/3814377421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 0x7f706c09d7f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.565+0000 7f70746d8640 1 -- 172.21.15.33:0/3814377421 >> 172.21.15.33:0/3814377421 conn(0x7f706c0bebf0 msgr2=0x7f706c0bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.566+0000 7f70746d8640 1 -- 172.21.15.33:0/3814377421 shutdown_connections 2024-04-25T15:20:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.566+0000 7f70746d8640 1 -- 172.21.15.33:0/3814377421 wait complete. 2024-04-25T15:20:42.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.567+0000 7f70746d8640 1 Processor -- start 2024-04-25T15:20:42.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.567+0000 7f70746d8640 1 -- start start 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f70746d8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f706c06d230 0x7f706c14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f70746d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 0x7f706c09f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f70746d8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706c149840 0x7f706c0b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f70746d8640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f706c0bd100 con 0x7f706c149840 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f70746d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f706c06d640 con 0x7f706c09d3e0 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f70746d8640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f706c14b700 con 0x7f706c06d230 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f7072c75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706c149840 0x7f706c0b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f7072c75640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706c149840 0x7f706c0b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56918/0 (socket says 172.21.15.33:56918) 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f7072c75640 1 -- 172.21.15.33:0/312982032 learned_addr learned my addr 172.21.15.33:0/312982032 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f7071c73640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 0x7f706c09f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.568+0000 7f7072474640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f706c06d230 0x7f706c14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7072c75640 1 -- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f706c06d230 msgr2=0x7f706c14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7072c75640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f706c06d230 0x7f706c14acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7072c75640 1 -- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 msgr2=0x7f706c09f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7072c75640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 0x7f706c09f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7072c75640 1 -- 172.21.15.33:0/312982032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c14b230 con 0x7f706c149840 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7072c75640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706c149840 0x7f706c0b4b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7064009eb0 tx=0x7f7064004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7062ffd640 1 -- 172.21.15.33:0/312982032 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706403f070 con 0x7f706c149840 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7062ffd640 1 -- 172.21.15.33:0/312982032 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7064031b40 con 0x7f706c149840 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706c1dfe80 con 0x7f706c149840 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f7062ffd640 1 -- 172.21.15.33:0/312982032 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7064043410 con 0x7f706c149840 2024-04-25T15:20:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.569+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706c09ff50 con 0x7f706c149840 2024-04-25T15:20:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.570+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706c0764e0 con 0x7f706c149840 2024-04-25T15:20:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.571+0000 7f7062ffd640 1 -- 172.21.15.33:0/312982032 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f706403b410 con 0x7f706c149840 2024-04-25T15:20:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.571+0000 7f7062ffd640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70500744b0 0x7f70500769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.571+0000 7f7062ffd640 1 -- 172.21.15.33:0/312982032 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f70640b6650 con 0x7f706c149840 2024-04-25T15:20:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.571+0000 7f7072474640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70500744b0 0x7f70500769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.572+0000 7f7072474640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70500744b0 0x7f70500769c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7068007fd0 tx=0x7f7068009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.576+0000 7f7062ffd640 1 -- 172.21.15.33:0/312982032 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7064080e70 con 0x7f706c149840 2024-04-25T15:20:42.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.762+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f706c14a9a0 con 0x7f706c149840 2024-04-25T15:20:42.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.763+0000 7f7062ffd640 1 -- 172.21.15.33:0/312982032 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16606 (secure 0 0 0) 0x7f7064080770 con 0x7f706c149840 2024-04-25T15:20:42.765 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:42.765 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:41.780715+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70500744b0 msgr2=0x7f70500769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70500744b0 0x7f70500769c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7068007fd0 tx=0x7f7068009040 comp rx=0 tx=0).stop 2024-04-25T15:20:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706c149840 msgr2=0x7f706c0b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706c149840 0x7f706c0b4b20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7064009eb0 tx=0x7f7064004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 shutdown_connections 2024-04-25T15:20:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70500744b0 0x7f70500769c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f706c149840 0x7f706c0b4b20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f706c09d3e0 0x7f706c09f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 --2- 172.21.15.33:0/312982032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f706c06d230 0x7f706c14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 >> 172.21.15.33:0/312982032 conn(0x7f706c0bebf0 msgr2=0x7f706c0b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:42.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 shutdown_connections 2024-04-25T15:20:42.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.765+0000 7f70746d8640 1 -- 172.21.15.33:0/312982032 wait complete. 2024-04-25T15:20:42.778 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.888+0000 7f224f340640 1 Processor -- start 2024-04-25T15:20:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.888+0000 7f224f340640 1 -- start start 2024-04-25T15:20:42.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224f340640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2248070550 0x7f22480b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224f340640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f2248147c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224f340640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2248148190 0x7f22480b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.893 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224f340640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f22480b8730 con 0x7f2248148190 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224f340640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f22480b8cf0 con 0x7f2248070550 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224f340640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f22480b3270 con 0x7f22480b23e0 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d8dd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2248148190 0x7f22480b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d8dd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2248148190 0x7f22480b7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56932/0 (socket says 172.21.15.33:56932) 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d8dd640 1 -- 172.21.15.33:0/2368041030 learned_addr learned my addr 172.21.15.33:0/2368041030 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d0dc640 1 --2- 172.21.15.33:0/2368041030 >> v2:172.21.15.155:3300/0 conn(0x7f2248070550 0x7f22480b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224c8db640 1 --2- 172.21.15.33:0/2368041030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f2248147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d8dd640 1 -- 172.21.15.33:0/2368041030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 msgr2=0x7f2248147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d8dd640 1 --2- 172.21.15.33:0/2368041030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f2248147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d8dd640 1 -- 172.21.15.33:0/2368041030 >> v2:172.21.15.155:3300/0 conn(0x7f2248070550 msgr2=0x7f22480b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:42.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d8dd640 1 --2- 172.21.15.33:0/2368041030 >> v2:172.21.15.155:3300/0 conn(0x7f2248070550 0x7f22480b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.889+0000 7f224d8dd640 1 -- 172.21.15.33:0/2368041030 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22480b3c50 con 0x7f2248148190 2024-04-25T15:20:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.890+0000 7f224d8dd640 1 --2- 172.21.15.33:0/2368041030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248148190 0x7f22480b7510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2248063fa0 tx=0x7f224002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763646bef1e5f1b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.890+0000 7f223ffff640 1 -- 172.21.15.33:0/2368041030 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240036070 con 0x7f2248148190 2024-04-25T15:20:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.890+0000 7f223ffff640 1 -- 172.21.15.33:0/2368041030 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2240031600 con 0x7f2248148190 2024-04-25T15:20:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.890+0000 7f223ffff640 1 -- 172.21.15.33:0/2368041030 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400319d0 con 0x7f2248148190 2024-04-25T15:20:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 -- 172.21.15.33:0/2368041030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248148190 msgr2=0x7f22480b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 --2- 172.21.15.33:0/2368041030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248148190 0x7f22480b7510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2248063fa0 tx=0x7f224002a570 comp rx=0 tx=0).stop 2024-04-25T15:20:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 -- 172.21.15.33:0/2368041030 shutdown_connections 2024-04-25T15:20:42.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 --2- 172.21.15.33:0/2368041030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248148190 0x7f22480b7510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 --2- 172.21.15.33:0/2368041030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f2248147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 --2- 172.21.15.33:0/2368041030 >> v2:172.21.15.155:3300/0 conn(0x7f2248070550 0x7f22480b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 -- 172.21.15.33:0/2368041030 >> 172.21.15.33:0/2368041030 conn(0x7f2248063ad0 msgr2=0x7f22480bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:42.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 -- 172.21.15.33:0/2368041030 shutdown_connections 2024-04-25T15:20:42.896 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.891+0000 7f224f340640 1 -- 172.21.15.33:0/2368041030 wait complete. 2024-04-25T15:20:42.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.893+0000 7f224f340640 1 Processor -- start 2024-04-25T15:20:42.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.893+0000 7f224f340640 1 -- start start 2024-04-25T15:20:42.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224f340640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248070550 0x7f224814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.899 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224f340640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f224806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224f340640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248148190 0x7f224809fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224f340640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2248070960 con 0x7f2248070550 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224f340640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22480b8980 con 0x7f2248148190 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224f340640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2248071990 con 0x7f22480b23e0 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248070550 0x7f224814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248070550 0x7f224814b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56936/0 (socket says 172.21.15.33:56936) 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 -- 172.21.15.33:0/4102931603 learned_addr learned my addr 172.21.15.33:0/4102931603 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224c8db640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f224806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d8dd640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248148190 0x7f224809fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 -- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 msgr2=0x7f224806edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f224806edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 -- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248148190 msgr2=0x7f224809fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248148190 0x7f224809fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 -- 172.21.15.33:0/4102931603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22481437a0 con 0x7f2248070550 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224c8db640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f224806edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224d0dc640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248070550 0x7f224814b020 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f224400e8a0 tx=0x7f224400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f223dffb640 1 -- 172.21.15.33:0/4102931603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244017070 con 0x7f2248070550 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f223dffb640 1 -- 172.21.15.33:0/4102931603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224400c940 con 0x7f2248070550 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224806f2f0 con 0x7f2248070550 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.894+0000 7f223dffb640 1 -- 172.21.15.33:0/4102931603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224400cd30 con 0x7f2248070550 2024-04-25T15:20:42.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.895+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f224806dde0 con 0x7f2248070550 2024-04-25T15:20:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.896+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22480764e0 con 0x7f2248070550 2024-04-25T15:20:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.896+0000 7f223dffb640 1 -- 172.21.15.33:0/4102931603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f224401a070 con 0x7f2248070550 2024-04-25T15:20:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.897+0000 7f223dffb640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f222c0744e0 0x7f222c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.897+0000 7f223dffb640 1 -- 172.21.15.33:0/4102931603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f2244094f50 con 0x7f2248070550 2024-04-25T15:20:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.897+0000 7f224c8db640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f222c0744e0 0x7f222c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:42.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.898+0000 7f224c8db640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f222c0744e0 0x7f222c0769f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f224814bcd0 tx=0x7f2238008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:42.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:42.902+0000 7f223dffb640 1 -- 172.21.15.33:0/4102931603 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f224405f120 con 0x7f2248070550 2024-04-25T15:20:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.086+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22480b6020 con 0x7f2248070550 2024-04-25T15:20:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.087+0000 7f223dffb640 1 -- 172.21.15.33:0/4102931603 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16606 (secure 0 0 0) 0x7f2244063420 con 0x7f2248070550 2024-04-25T15:20:43.089 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:43.089 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:41.780715+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f222c0744e0 msgr2=0x7f222c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f222c0744e0 0x7f222c0769f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f224814bcd0 tx=0x7f2238008040 comp rx=0 tx=0).stop 2024-04-25T15:20:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248070550 msgr2=0x7f224814b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248070550 0x7f224814b020 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f224400e8a0 tx=0x7f224400ed60 comp rx=0 tx=0).stop 2024-04-25T15:20:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 shutdown_connections 2024-04-25T15:20:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f222c0744e0 0x7f222c0769f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2248148190 0x7f224809fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22480b23e0 0x7f224806edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 --2- 172.21.15.33:0/4102931603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2248070550 0x7f224814b020 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 >> 172.21.15.33:0/4102931603 conn(0x7f2248063ad0 msgr2=0x7f2248075ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 shutdown_connections 2024-04-25T15:20:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.089+0000 7f224f340640 1 -- 172.21.15.33:0/4102931603 wait complete. 2024-04-25T15:20:43.102 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T15:20:43.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.215+0000 7fa2dae20640 1 Processor -- start 2024-04-25T15:20:43.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.215+0000 7fa2dae20640 1 -- start start 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2dae20640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa2d40bbf60 0x7fa2d414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2dae20640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 0x7fa2d414d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2dae20640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2d40b69f0 con 0x7fa2d4073150 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2dae20640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fa2d4073f30 con 0x7fa2d40bbf60 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2dae20640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d40b7040 con 0x7fa2d40bc370 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2d3fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa2d40bbf60 0x7fa2d414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2d3fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa2d40bbf60 0x7fa2d414cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56944/0 (socket says 172.21.15.33:56944) 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2d3fff640 1 -- 172.21.15.33:0/380342655 learned_addr learned my addr 172.21.15.33:0/380342655 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2d93bd640 1 --2- 172.21.15.33:0/380342655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 0x7fa2d414d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2d3fff640 1 -- 172.21.15.33:0/380342655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 msgr2=0x7fa2d414d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:43.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2d3fff640 1 --2- 172.21.15.33:0/380342655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 0x7fa2d414d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2d3fff640 1 -- 172.21.15.33:0/380342655 >> v1:172.21.15.155:6789/0 conn(0x7fa2d4073150 legacy=0x7fa2d4143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:43.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.216+0000 7fa2d3fff640 1 -- 172.21.15.33:0/380342655 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d40b6cd0 con 0x7fa2d40bbf60 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.217+0000 7fa2d3fff640 1 --2- 172.21.15.33:0/380342655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d40bbf60 0x7fa2d414cd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009870 tx=0x7fa2c002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2376d23c0e1edb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.217+0000 7fa2d37fe640 1 -- 172.21.15.33:0/380342655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0037070 con 0x7fa2d40bbf60 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.217+0000 7fa2d37fe640 1 -- 172.21.15.33:0/380342655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c0032440 con 0x7fa2d40bbf60 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.217+0000 7fa2d37fe640 1 -- 172.21.15.33:0/380342655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0032810 con 0x7fa2d40bbf60 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.218+0000 7fa2dae20640 1 -- 172.21.15.33:0/380342655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d40bbf60 msgr2=0x7fa2d414cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.218+0000 7fa2dae20640 1 --2- 172.21.15.33:0/380342655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d40bbf60 0x7fa2d414cd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009870 tx=0x7fa2c002a1c0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.218+0000 7fa2dae20640 1 -- 172.21.15.33:0/380342655 shutdown_connections 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.218+0000 7fa2dae20640 1 --2- 172.21.15.33:0/380342655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 0x7fa2d414d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.218+0000 7fa2dae20640 1 --2- 172.21.15.33:0/380342655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d40bbf60 0x7fa2d414cd80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.218+0000 7fa2dae20640 1 -- 172.21.15.33:0/380342655 >> 172.21.15.33:0/380342655 conn(0x7fa2d40b8b10 msgr2=0x7fa2d40bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.218+0000 7fa2dae20640 1 -- 172.21.15.33:0/380342655 shutdown_connections 2024-04-25T15:20:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.218+0000 7fa2dae20640 1 -- 172.21.15.33:0/380342655 wait complete. 2024-04-25T15:20:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.219+0000 7fa2dae20640 1 Processor -- start 2024-04-25T15:20:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.219+0000 7fa2dae20640 1 -- start start 2024-04-25T15:20:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.220+0000 7fa2dae20640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4073150 0x7fa2d40b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.220+0000 7fa2dae20640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d40bbf60 0x7fa2d40ba660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.220+0000 7fa2dae20640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 0x7fa2d413b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.220+0000 7fa2dae20640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d40736e0 con 0x7fa2d4073150 2024-04-25T15:20:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.220+0000 7fa2dae20640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4073560 con 0x7fa2d40bbf60 2024-04-25T15:20:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.220+0000 7fa2dae20640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa2d4154080 con 0x7fa2d40bc370 2024-04-25T15:20:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4073150 0x7fa2d40b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4073150 0x7fa2d40b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56958/0 (socket says 172.21.15.33:56958) 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 -- 172.21.15.33:0/3859704266 learned_addr learned my addr 172.21.15.33:0/3859704266 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d93bd640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 0x7fa2d413b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d3fff640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d40bbf60 0x7fa2d40ba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 -- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 msgr2=0x7fa2d413b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 0x7fa2d413b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 -- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d40bbf60 msgr2=0x7fa2d40ba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d40bbf60 0x7fa2d40ba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 -- 172.21.15.33:0/3859704266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d40b9810 con 0x7fa2d4073150 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d8bbc640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4073150 0x7fa2d40b3fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c3f0 tx=0x7fa2c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d17fa640 1 -- 172.21.15.33:0/3859704266 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80052d0 con 0x7fa2d4073150 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d17fa640 1 -- 172.21.15.33:0/3859704266 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c8005490 con 0x7fa2d4073150 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d413e6c0 con 0x7fa2d4073150 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2d17fa640 1 -- 172.21.15.33:0/3859704266 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8007260 con 0x7fa2d4073150 2024-04-25T15:20:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.221+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d40baba0 con 0x7fa2d4073150 2024-04-25T15:20:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.222+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d413e890 con 0x7fa2d4073150 2024-04-25T15:20:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.223+0000 7fa2d17fa640 1 -- 172.21.15.33:0/3859704266 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa2c8007400 con 0x7fa2d4073150 2024-04-25T15:20:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.223+0000 7fa2d17fa640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa2b80744e0 0x7fa2b80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.223+0000 7fa2d17fa640 1 -- 172.21.15.33:0/3859704266 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fa2c8094510 con 0x7fa2d4073150 2024-04-25T15:20:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.223+0000 7fa2d3fff640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa2b80744e0 0x7fa2b80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.224+0000 7fa2d3fff640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa2b80744e0 0x7fa2b80769f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0034000 tx=0x7fa2c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.228+0000 7fa2d17fa640 1 -- 172.21.15.33:0/3859704266 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2c805e770 con 0x7fa2d4073150 2024-04-25T15:20:43.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:43.455+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa2d40764e0 con 0x7fa2d4073150 2024-04-25T15:20:44.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.424+0000 7fa2d17fa640 1 -- 172.21.15.33:0/3859704266 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa2c8062a70 con 0x7fa2d4073150 2024-04-25T15:20:44.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa2b80744e0 msgr2=0x7fa2b80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa2b80744e0 0x7fa2b80769f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0034000 tx=0x7fa2c002e000 comp rx=0 tx=0).stop 2024-04-25T15:20:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4073150 msgr2=0x7fa2d40b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4073150 0x7fa2d40b3fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c3f0 tx=0x7fa2c800c8b0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 shutdown_connections 2024-04-25T15:20:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa2b80744e0 0x7fa2b80769f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2d40bc370 0x7fa2d413b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2d40bbf60 0x7fa2d40ba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 --2- 172.21.15.33:0/3859704266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d4073150 0x7fa2d40b3fb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.426+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 >> 172.21.15.33:0/3859704266 conn(0x7fa2d40b8b10 msgr2=0x7fa2d4149ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.427+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 shutdown_connections 2024-04-25T15:20:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.427+0000 7fa2dae20640 1 -- 172.21.15.33:0/3859704266 wait complete. 2024-04-25T15:20:44.442 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T15:20:44.442 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T15:20:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.562+0000 7f844b242640 1 Processor -- start 2024-04-25T15:20:44.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.562+0000 7f844b242640 1 -- start start 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.563+0000 7f844b242640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f844406d230 0x7f844409d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.563+0000 7f844b242640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f844409dae0 0x7f84440b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.563+0000 7f844b242640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84440b9650 con 0x7f84440ba320 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.563+0000 7f844b242640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f84440be0c0 con 0x7f844406d230 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.563+0000 7f844b242640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f84440ba730 con 0x7f844409dae0 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.563+0000 7f8448fde640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f844406d230 0x7f844409d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.563+0000 7f8448fde640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f844406d230 0x7f844409d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50902/0 (socket says 172.21.15.33:50902) 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.563+0000 7f8448fde640 1 -- 172.21.15.33:0/2568884144 learned_addr learned my addr 172.21.15.33:0/2568884144 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.564+0000 7f8443fff640 1 --2- 172.21.15.33:0/2568884144 >> v2:172.21.15.155:3300/0 conn(0x7f844409dae0 0x7f84440b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.564+0000 7f8448fde640 1 -- 172.21.15.33:0/2568884144 >> v2:172.21.15.155:3300/0 conn(0x7f844409dae0 msgr2=0x7f84440b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:44.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.564+0000 7f8448fde640 1 --2- 172.21.15.33:0/2568884144 >> v2:172.21.15.155:3300/0 conn(0x7f844409dae0 0x7f84440b9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.564+0000 7f8448fde640 1 -- 172.21.15.33:0/2568884144 >> v1:172.21.15.155:6789/0 conn(0x7f84440ba320 legacy=0x7f8444149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:44.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.564+0000 7f8448fde640 1 -- 172.21.15.33:0/2568884144 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84440b98c0 con 0x7f844406d230 2024-04-25T15:20:44.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.564+0000 7f8443fff640 1 --2- 172.21.15.33:0/2568884144 >> v2:172.21.15.155:3300/0 conn(0x7f844409dae0 0x7f84440b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:44.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.564+0000 7f8448fde640 1 --2- 172.21.15.33:0/2568884144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f844409d5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f84440bfcd0 tx=0x7f843c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e026504a662ccb72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:44.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f84437fe640 1 -- 172.21.15.33:0/2568884144 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c036070 con 0x7f844406d230 2024-04-25T15:20:44.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f84437fe640 1 -- 172.21.15.33:0/2568884144 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843c031600 con 0x7f844406d230 2024-04-25T15:20:44.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f84437fe640 1 -- 172.21.15.33:0/2568884144 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c0319d0 con 0x7f844406d230 2024-04-25T15:20:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f844b242640 1 -- 172.21.15.33:0/2568884144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 msgr2=0x7f844409d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f844b242640 1 --2- 172.21.15.33:0/2568884144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f844409d5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f84440bfcd0 tx=0x7f843c02a660 comp rx=0 tx=0).stop 2024-04-25T15:20:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f844b242640 1 -- 172.21.15.33:0/2568884144 shutdown_connections 2024-04-25T15:20:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f844b242640 1 --2- 172.21.15.33:0/2568884144 >> v2:172.21.15.155:3300/0 conn(0x7f844409dae0 0x7f84440b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f844b242640 1 --2- 172.21.15.33:0/2568884144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f844409d5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f844b242640 1 -- 172.21.15.33:0/2568884144 >> 172.21.15.33:0/2568884144 conn(0x7f84440bebf0 msgr2=0x7f84440bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f844b242640 1 -- 172.21.15.33:0/2568884144 shutdown_connections 2024-04-25T15:20:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.565+0000 7f844b242640 1 -- 172.21.15.33:0/2568884144 wait complete. 2024-04-25T15:20:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.567+0000 7f844b242640 1 Processor -- start 2024-04-25T15:20:44.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.567+0000 7f844b242640 1 -- start start 2024-04-25T15:20:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f844b242640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f84441e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f844b242640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844409dae0 0x7f844414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f844b242640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84440ba320 0x7f84441e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f844b242640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f844414a180 con 0x7f844406d230 2024-04-25T15:20:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f844b242640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f844414a760 con 0x7f844409dae0 2024-04-25T15:20:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f844b242640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f844414a300 con 0x7f84440ba320 2024-04-25T15:20:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8448fde640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f84441e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:44.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8448fde640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f84441e3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50906/0 (socket says 172.21.15.33:50906) 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8448fde640 1 -- 172.21.15.33:0/4288897630 learned_addr learned my addr 172.21.15.33:0/4288897630 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8443fff640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844409dae0 0x7f844414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f84497df640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84440ba320 0x7f84441e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8448fde640 1 -- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84440ba320 msgr2=0x7f84441e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8448fde640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84440ba320 0x7f84441e00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8448fde640 1 -- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844409dae0 msgr2=0x7f844414d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8448fde640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844409dae0 0x7f844414d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f8448fde640 1 -- 172.21.15.33:0/4288897630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84441e31b0 con 0x7f844406d230 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.568+0000 7f84497df640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84440ba320 0x7f84441e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.569+0000 7f8448fde640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f84441e3c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f843c02ac50 tx=0x7f843c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.569+0000 7f84417fa640 1 -- 172.21.15.33:0/4288897630 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c041020 con 0x7f844406d230 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.569+0000 7f84417fa640 1 -- 172.21.15.33:0/4288897630 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843c007800 con 0x7f844406d230 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.569+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84441e3450 con 0x7f844406d230 2024-04-25T15:20:44.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.569+0000 7f84417fa640 1 -- 172.21.15.33:0/4288897630 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c036040 con 0x7f844406d230 2024-04-25T15:20:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.569+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84440a1890 con 0x7f844406d230 2024-04-25T15:20:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.570+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84440764e0 con 0x7f844406d230 2024-04-25T15:20:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.571+0000 7f84417fa640 1 -- 172.21.15.33:0/4288897630 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f843c044020 con 0x7f844406d230 2024-04-25T15:20:44.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.571+0000 7f84417fa640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f84240744b0 0x7f84240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:44.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.571+0000 7f84417fa640 1 -- 172.21.15.33:0/4288897630 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f843c0b6210 con 0x7f844406d230 2024-04-25T15:20:44.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.571+0000 7f8443fff640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f84240744b0 0x7f84240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:44.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.572+0000 7f8443fff640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f84240744b0 0x7f84240769c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f844414dac0 tx=0x7f842c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:44.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.576+0000 7f84417fa640 1 -- 172.21.15.33:0/4288897630 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f843c04b020 con 0x7f844406d230 2024-04-25T15:20:44.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:44.798+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f84440b9e80 con 0x7f844406d230 2024-04-25T15:20:45.374 INFO:tasks.ceph.mds.a.smithi033.stderr:2024-04-25T15:20:45.372+0000 7fd95a9fc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T15:20:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.433+0000 7f84417fa640 1 -- 172.21.15.33:0/4288897630 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f843c080a30 con 0x7f844406d230 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f84240744b0 msgr2=0x7f84240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f84240744b0 0x7f84240769c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f844414dac0 tx=0x7f842c008040 comp rx=0 tx=0).stop 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 msgr2=0x7f84441e3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f84441e3c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f843c02ac50 tx=0x7f843c004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 shutdown_connections 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f84240744b0 0x7f84240769c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84440ba320 0x7f84441e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844409dae0 0x7f844414d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 --2- 172.21.15.33:0/4288897630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f844406d230 0x7f84441e3c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 >> 172.21.15.33:0/4288897630 conn(0x7f84440bebf0 msgr2=0x7f84440bd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 shutdown_connections 2024-04-25T15:20:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.436+0000 7f844b242640 1 -- 172.21.15.33:0/4288897630 wait complete. 2024-04-25T15:20:45.451 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T15:20:45.451 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:20:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.568+0000 7fd95a4f9640 1 Processor -- start 2024-04-25T15:20:45.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.568+0000 7fd95a4f9640 1 -- start start 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd95a4f9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9540b6d70 0x7fd9540b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd95a4f9640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd954146620 0x7fd954146a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd95a4f9640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9540b7580 con 0x7fd9540bc140 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd95a4f9640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fd9540b7860 con 0x7fd954146620 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd95a4f9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd9540b7b40 con 0x7fd9540b6d70 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd958a96640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd954146620 0x7fd954146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd9537fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd9540bc140 0x7fd954140320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45144/0 (socket says 172.21.15.33:45144) 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd9537fe640 1 -- 172.21.15.33:0/4051932074 learned_addr learned my addr 172.21.15.33:0/4051932074 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.569+0000 7fd953fff640 1 --2- 172.21.15.33:0/4051932074 >> v2:172.21.15.155:3300/0 conn(0x7fd9540b6d70 0x7fd9540b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.570+0000 7fd958a96640 1 -- 172.21.15.33:0/4051932074 >> v2:172.21.15.155:3300/0 conn(0x7fd9540b6d70 msgr2=0x7fd9540b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.570+0000 7fd958a96640 1 --2- 172.21.15.33:0/4051932074 >> v2:172.21.15.155:3300/0 conn(0x7fd9540b6d70 0x7fd9540b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.570+0000 7fd958a96640 1 -- 172.21.15.33:0/4051932074 >> v1:172.21.15.33:6789/0 conn(0x7fd9540bc140 legacy=0x7fd954140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.570+0000 7fd952ffd640 1 -- 172.21.15.33:0/4051932074 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975473388 0 0) 0x7fd9540b7580 con 0x7fd9540bc140 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.570+0000 7fd958a96640 1 -- 172.21.15.33:0/4051932074 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9540b7e20 con 0x7fd954146620 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.570+0000 7fd958a96640 1 --2- 172.21.15.33:0/4051932074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd954146620 0x7fd954146a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd954071310 tx=0x7fd94c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd0118a7722553 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.570+0000 7fd952ffd640 1 -- 172.21.15.33:0/4051932074 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c007740 con 0x7fd954146620 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd952ffd640 1 -- 172.21.15.33:0/4051932074 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94c0078e0 con 0x7fd954146620 2024-04-25T15:20:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd952ffd640 1 -- 172.21.15.33:0/4051932074 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c007cb0 con 0x7fd954146620 2024-04-25T15:20:45.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd95a4f9640 1 -- 172.21.15.33:0/4051932074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd954146620 msgr2=0x7fd954146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/4051932074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd954146620 0x7fd954146a30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd954071310 tx=0x7fd94c02a5f0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd95a4f9640 1 -- 172.21.15.33:0/4051932074 shutdown_connections 2024-04-25T15:20:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/4051932074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd954146620 0x7fd954146a30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/4051932074 >> v2:172.21.15.155:3300/0 conn(0x7fd9540b6d70 0x7fd9540b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd95a4f9640 1 -- 172.21.15.33:0/4051932074 >> 172.21.15.33:0/4051932074 conn(0x7fd9540b8b10 msgr2=0x7fd9540bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd95a4f9640 1 -- 172.21.15.33:0/4051932074 shutdown_connections 2024-04-25T15:20:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.571+0000 7fd95a4f9640 1 -- 172.21.15.33:0/4051932074 wait complete. 2024-04-25T15:20:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.573+0000 7fd95a4f9640 1 Processor -- start 2024-04-25T15:20:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.573+0000 7fd95a4f9640 1 -- start start 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd95a4f9640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9540b6d70 0x7fd954148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd95a4f9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9540bc140 0x7fd9541458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd95a4f9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd954146620 0x7fd954130ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd95a4f9640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd954140a30 con 0x7fd9540b6d70 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd95a4f9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540bc550 con 0x7fd954146620 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd95a4f9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd954140bb0 con 0x7fd9540bc140 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd953fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9540b6d70 0x7fd954148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd953fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9540b6d70 0x7fd954148c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50930/0 (socket says 172.21.15.33:50930) 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd953fff640 1 -- 172.21.15.33:0/1666336885 learned_addr learned my addr 172.21.15.33:0/1666336885 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd9537fe640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9540bc140 0x7fd9541458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd958a96640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd954146620 0x7fd954130ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd953fff640 1 -- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9540bc140 msgr2=0x7fd9541458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd953fff640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9540bc140 0x7fd9541458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd953fff640 1 -- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd954146620 msgr2=0x7fd954130ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd953fff640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd954146620 0x7fd954130ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd953fff640 1 -- 172.21.15.33:0/1666336885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd954134d10 con 0x7fd9540b6d70 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd9537fe640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9540bc140 0x7fd9541458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.574+0000 7fd958a96640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd954146620 0x7fd954130ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.575+0000 7fd953fff640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9540b6d70 0x7fd954148c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd94400e870 tx=0x7fd94400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.575+0000 7fd950ff9640 1 -- 172.21.15.33:0/1666336885 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944017070 con 0x7fd9540b6d70 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.575+0000 7fd950ff9640 1 -- 172.21.15.33:0/1666336885 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94400ee60 con 0x7fd9540b6d70 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.575+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd954144630 con 0x7fd9540b6d70 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.575+0000 7fd950ff9640 1 -- 172.21.15.33:0/1666336885 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94400cb00 con 0x7fd9540b6d70 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.575+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd954148400 con 0x7fd9540b6d70 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.576+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9540764e0 con 0x7fd9540b6d70 2024-04-25T15:20:45.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.576+0000 7fd950ff9640 1 -- 172.21.15.33:0/1666336885 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd94401a070 con 0x7fd9540b6d70 2024-04-25T15:20:45.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.577+0000 7fd950ff9640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd9340744e0 0x7fd9340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.577+0000 7fd950ff9640 1 -- 172.21.15.33:0/1666336885 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd944095740 con 0x7fd9540b6d70 2024-04-25T15:20:45.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.577+0000 7fd9537fe640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd9340744e0 0x7fd9340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.578+0000 7fd9537fe640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd9340744e0 0x7fd9340769f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd93c000f60 tx=0x7fd93c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:45.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.582+0000 7fd950ff9640 1 -- 172.21.15.33:0/1666336885 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd94405fed0 con 0x7fd9540b6d70 2024-04-25T15:20:45.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.808+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd95413d860 con 0x7fd9540b6d70 2024-04-25T15:20:45.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.809+0000 7fd950ff9640 1 -- 172.21.15.33:0/1666336885 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3524 (secure 0 0 0) 0x7fd94405f7d0 con 0x7fd9540b6d70 2024-04-25T15:20:45.810 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:45.810 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2065139550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2065139550},{"type":"v1","addr":"172.21.15.155:6835","nonce":2065139550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:20:41.780676+0000","modified":"2024-04-25T15:20:44.800148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/23089112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":23089112},{"type":"v1","addr":"172.21.15.33:6833","nonce":23089112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-04-25T15:20:45.811 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-04-25T15:20:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd9340744e0 msgr2=0x7fd9340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd9340744e0 0x7fd9340769f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd93c000f60 tx=0x7fd93c009040 comp rx=0 tx=0).stop 2024-04-25T15:20:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9540b6d70 msgr2=0x7fd954148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9540b6d70 0x7fd954148c00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd94400e870 tx=0x7fd94400ed30 comp rx=0 tx=0).stop 2024-04-25T15:20:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 shutdown_connections 2024-04-25T15:20:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd9340744e0 0x7fd9340769f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd954146620 0x7fd954130ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9540bc140 0x7fd9541458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 --2- 172.21.15.33:0/1666336885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9540b6d70 0x7fd954148c00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 >> 172.21.15.33:0/1666336885 conn(0x7fd9540b8b10 msgr2=0x7fd954075ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 shutdown_connections 2024-04-25T15:20:45.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.811+0000 7fd95a4f9640 1 -- 172.21.15.33:0/1666336885 wait complete. 2024-04-25T15:20:45.823 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:45.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.933+0000 7f43f9492640 1 Processor -- start 2024-04-25T15:20:45.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.933+0000 7f43f9492640 1 -- start start 2024-04-25T15:20:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43f9492640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f43f4149840 0x7f43f406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43f9492640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43f40be0e0 0x7f43f40bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43f9492640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f4149d40 con 0x7f43f40be4f0 2024-04-25T15:20:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43f9492640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f43f414a820 con 0x7f43f4149840 2024-04-25T15:20:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43f9492640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f43f414a020 con 0x7f43f40be0e0 2024-04-25T15:20:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43f2ffd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f43f4149840 0x7f43f406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43f37fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f43f40be4f0 0x7f43f409d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45148/0 (socket says 172.21.15.33:45148) 2024-04-25T15:20:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43f37fe640 1 -- 172.21.15.33:0/1521261924 learned_addr learned my addr 172.21.15.33:0/1521261924 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:45.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.934+0000 7f43ebfff640 1 --2- 172.21.15.33:0/1521261924 >> v2:172.21.15.155:3300/0 conn(0x7f43f40be0e0 0x7f43f40bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f2ffd640 1 -- 172.21.15.33:0/1521261924 >> v2:172.21.15.155:3300/0 conn(0x7f43f40be0e0 msgr2=0x7f43f40bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:45.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f2ffd640 1 --2- 172.21.15.33:0/1521261924 >> v2:172.21.15.155:3300/0 conn(0x7f43f40be0e0 0x7f43f40bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f2ffd640 1 -- 172.21.15.33:0/1521261924 >> v1:172.21.15.33:6789/0 conn(0x7f43f40be4f0 legacy=0x7f43f409d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f27fc640 1 -- 172.21.15.33:0/1521261924 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283585873 0 0) 0x7f43f4149d40 con 0x7f43f40be4f0 2024-04-25T15:20:45.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f2ffd640 1 -- 172.21.15.33:0/1521261924 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f414a300 con 0x7f43f4149840 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f2ffd640 1 --2- 172.21.15.33:0/1521261924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f406d230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f43f40bfcf0 tx=0x7f43e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ff42d19cfbe0ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f27fc640 1 -- 172.21.15.33:0/1521261924 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4037070 con 0x7f43f4149840 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f27fc640 1 -- 172.21.15.33:0/1521261924 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4032440 con 0x7f43f4149840 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.935+0000 7f43f27fc640 1 -- 172.21.15.33:0/1521261924 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4032810 con 0x7f43f4149840 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.936+0000 7f43f9492640 1 -- 172.21.15.33:0/1521261924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 msgr2=0x7f43f406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.936+0000 7f43f9492640 1 --2- 172.21.15.33:0/1521261924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f406d230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f43f40bfcf0 tx=0x7f43e402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.936+0000 7f43f9492640 1 -- 172.21.15.33:0/1521261924 shutdown_connections 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.936+0000 7f43f9492640 1 --2- 172.21.15.33:0/1521261924 >> v2:172.21.15.155:3300/0 conn(0x7f43f40be0e0 0x7f43f40bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.936+0000 7f43f9492640 1 --2- 172.21.15.33:0/1521261924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f406d230 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.936+0000 7f43f9492640 1 -- 172.21.15.33:0/1521261924 >> 172.21.15.33:0/1521261924 conn(0x7f43f40bebf0 msgr2=0x7f43f40bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.936+0000 7f43f9492640 1 -- 172.21.15.33:0/1521261924 shutdown_connections 2024-04-25T15:20:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.936+0000 7f43f9492640 1 -- 172.21.15.33:0/1521261924 wait complete. 2024-04-25T15:20:45.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.938+0000 7f43f9492640 1 Processor -- start 2024-04-25T15:20:45.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.938+0000 7f43f9492640 1 -- start start 2024-04-25T15:20:45.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f9492640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f40be0e0 0x7f43f4143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f9492640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f40be4f0 0x7f43f414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f9492640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f40b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f9492640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f43f40bcf30 con 0x7f43f4149840 2024-04-25T15:20:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f9492640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43f409dd40 con 0x7f43f40be4f0 2024-04-25T15:20:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f9492640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f43f40bd0b0 con 0x7f43f40be0e0 2024-04-25T15:20:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f40b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f40b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50948/0 (socket says 172.21.15.33:50948) 2024-04-25T15:20:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 -- 172.21.15.33:0/1917652045 learned_addr learned my addr 172.21.15.33:0/1917652045 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43ebfff640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f40be4f0 0x7f43f414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f2ffd640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f40be0e0 0x7f43f4143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 -- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f40be0e0 msgr2=0x7f43f4143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f40be0e0 0x7f43f4143010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 -- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f40be4f0 msgr2=0x7f43f414c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f40be4f0 0x7f43f414c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 -- 172.21.15.33:0/1917652045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f414d550 con 0x7f43f4149840 2024-04-25T15:20:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f2ffd640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f40be0e0 0x7f43f4143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.939+0000 7f43f37fe640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f40b85a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00c780 tx=0x7f43ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.940+0000 7f43eb7fe640 1 -- 172.21.15.33:0/1917652045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec018070 con 0x7f43f4149840 2024-04-25T15:20:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.940+0000 7f43eb7fe640 1 -- 172.21.15.33:0/1917652045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec00ce30 con 0x7f43f4149840 2024-04-25T15:20:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.940+0000 7f43eb7fe640 1 -- 172.21.15.33:0/1917652045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00a7e0 con 0x7f43f4149840 2024-04-25T15:20:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.940+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f4141eb0 con 0x7f43f4149840 2024-04-25T15:20:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.940+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f41e2a60 con 0x7f43f4149840 2024-04-25T15:20:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.941+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f40764e0 con 0x7f43f4149840 2024-04-25T15:20:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.941+0000 7f43eb7fe640 1 -- 172.21.15.33:0/1917652045 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f43ec01b070 con 0x7f43f4149840 2024-04-25T15:20:45.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.942+0000 7f43eb7fe640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f43d40744b0 0x7f43d40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:45.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.942+0000 7f43eb7fe640 1 -- 172.21.15.33:0/1917652045 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f43ec0947c0 con 0x7f43f4149840 2024-04-25T15:20:45.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.942+0000 7f43f2ffd640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f43d40744b0 0x7f43d40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:45.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.943+0000 7f43f2ffd640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f43d40744b0 0x7f43d40769c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43e4034000 tx=0x7f43e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:45.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:45.947+0000 7f43eb7fe640 1 -- 172.21.15.33:0/1917652045 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43ec05eeb0 con 0x7f43f4149840 2024-04-25T15:20:46.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.131+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43f40b62a0 con 0x7f43f4149840 2024-04-25T15:20:46.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.132+0000 7f43eb7fe640 1 -- 172.21.15.33:0/1917652045 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f43ec05e7b0 con 0x7f43f4149840 2024-04-25T15:20:46.134 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:46.134 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:43.397488+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f43d40744b0 msgr2=0x7f43d40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f43d40744b0 0x7f43d40769c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43e4034000 tx=0x7f43e402e000 comp rx=0 tx=0).stop 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 msgr2=0x7f43f40b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f40b85a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00c780 tx=0x7f43ec00cc40 comp rx=0 tx=0).stop 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 shutdown_connections 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f43d40744b0 0x7f43d40769c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43f4149840 0x7f43f40b85a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43f40be4f0 0x7f43f414c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 --2- 172.21.15.33:0/1917652045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43f40be0e0 0x7f43f4143010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 >> 172.21.15.33:0/1917652045 conn(0x7f43f40bebf0 msgr2=0x7f43f40bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 shutdown_connections 2024-04-25T15:20:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.134+0000 7f43f9492640 1 -- 172.21.15.33:0/1917652045 wait complete. 2024-04-25T15:20:46.147 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T15:20:46.147 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:20:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.256+0000 7f3e03ff3640 1 Processor -- start 2024-04-25T15:20:46.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.257+0000 7f3e03ff3640 1 -- start start 2024-04-25T15:20:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e03ff3640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dfc06f320 0x7f3dfc070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e03ff3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06dbc0 0x7f3dfc149e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e03ff3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3dfc06dfd0 0x7f3dfc14a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e03ff3640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f3dfc06f730 con 0x7f3dfc06f320 2024-04-25T15:20:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e03ff3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3dfc0a2870 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e03ff3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc14a880 con 0x7f3dfc06dbc0 2024-04-25T15:20:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e01d8f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dfc06f320 0x7f3dfc070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e01d8f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dfc06f320 0x7f3dfc070550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50962/0 (socket says 172.21.15.33:50962) 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e01d8f640 1 -- 172.21.15.33:0/1354283276 learned_addr learned my addr 172.21.15.33:0/1354283276 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e0158e640 1 --2- 172.21.15.33:0/1354283276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06dbc0 0x7f3dfc149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e02590640 1 --2- 172.21.15.33:0/1354283276 >> v2:172.21.15.155:3300/0 conn(0x7f3dfc06dfd0 0x7f3dfc14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e01d8f640 1 -- 172.21.15.33:0/1354283276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06dbc0 msgr2=0x7f3dfc149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e01d8f640 1 --2- 172.21.15.33:0/1354283276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06dbc0 0x7f3dfc149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e01d8f640 1 -- 172.21.15.33:0/1354283276 >> v2:172.21.15.155:3300/0 conn(0x7f3dfc06dfd0 msgr2=0x7f3dfc14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e01d8f640 1 --2- 172.21.15.33:0/1354283276 >> v2:172.21.15.155:3300/0 conn(0x7f3dfc06dfd0 0x7f3dfc14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.258+0000 7f3e01d8f640 1 -- 172.21.15.33:0/1354283276 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc06ee90 con 0x7f3dfc06f320 2024-04-25T15:20:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.259+0000 7f3e01d8f640 1 --2- 172.21.15.33:0/1354283276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06f320 0x7f3dfc070550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0b9550 tx=0x7f3dec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe81c716fa6828d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.259+0000 7f3e00d8d640 1 -- 172.21.15.33:0/1354283276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec036070 con 0x7f3dfc06f320 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.259+0000 7f3e00d8d640 1 -- 172.21.15.33:0/1354283276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec031600 con 0x7f3dfc06f320 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.259+0000 7f3e00d8d640 1 -- 172.21.15.33:0/1354283276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0319d0 con 0x7f3dfc06f320 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1354283276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06f320 msgr2=0x7f3dfc070550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1354283276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06f320 0x7f3dfc070550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0b9550 tx=0x7f3dec02a6a0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1354283276 shutdown_connections 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1354283276 >> v2:172.21.15.155:3300/0 conn(0x7f3dfc06dfd0 0x7f3dfc14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1354283276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06dbc0 0x7f3dfc149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1354283276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06f320 0x7f3dfc070550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1354283276 >> 172.21.15.33:0/1354283276 conn(0x7f3dfc063ad0 msgr2=0x7f3dfc0bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1354283276 shutdown_connections 2024-04-25T15:20:46.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.260+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1354283276 wait complete. 2024-04-25T15:20:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.261+0000 7f3e03ff3640 1 Processor -- start 2024-04-25T15:20:46.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.261+0000 7f3e03ff3640 1 -- start start 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.262+0000 7f3e03ff3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dfc06dbc0 0x7f3dfc1df330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.262+0000 7f3e03ff3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06dfd0 0x7f3dfc144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.262+0000 7f3e03ff3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06f320 0x7f3dfc1418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.262+0000 7f3e03ff3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc149940 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.262+0000 7f3e03ff3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc0a2590 con 0x7f3dfc06dbc0 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.262+0000 7f3e03ff3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc0717e0 con 0x7f3dfc06f320 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06dfd0 0x7f3dfc144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06dfd0 0x7f3dfc144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50976/0 (socket says 172.21.15.33:50976) 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 -- 172.21.15.33:0/1227701751 learned_addr learned my addr 172.21.15.33:0/1227701751 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e01d8f640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dfc06dbc0 0x7f3dfc1df330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e02590640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06f320 0x7f3dfc1418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 -- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06f320 msgr2=0x7f3dfc1418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06f320 0x7f3dfc1418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 -- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dfc06dbc0 msgr2=0x7f3dfc1df330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dfc06dbc0 0x7f3dfc1df330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 -- 172.21.15.33:0/1227701751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc1df870 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e01d8f640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dfc06dbc0 0x7f3dfc1df330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e0158e640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06dfd0 0x7f3dfc144760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d600 tx=0x7f3df000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3dfa7fc640 1 -- 172.21.15.33:0/1227701751 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df00125f0 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3dfa7fc640 1 -- 172.21.15.33:0/1227701751 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df0019070 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc145200 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3dfa7fc640 1 -- 172.21.15.33:0/1227701751 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df00129b0 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.263+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc1e30c0 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.264+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dfc1e34a0 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.265+0000 7f3dfa7fc640 1 -- 172.21.15.33:0/1227701751 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3df0012b50 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.265+0000 7f3dfa7fc640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f3de80744b0 0x7f3de80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.265+0000 7f3dfa7fc640 1 -- 172.21.15.33:0/1227701751 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3df0095630 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.266+0000 7f3e01d8f640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f3de80744b0 0x7f3de80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.266+0000 7f3e01d8f640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f3de80744b0 0x7f3de80769c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3dec033000 tx=0x7f3dec009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:46.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.270+0000 7f3dfa7fc640 1 -- 172.21.15.33:0/1227701751 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3dfc1e34a0 con 0x7f3dfc06dfd0 2024-04-25T15:20:46.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.452+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3dfc0764e0 con 0x7f3de80744b0 2024-04-25T15:20:46.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.459+0000 7f3dfa7fc640 1 -- 172.21.15.33:0/1227701751 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251934 (secure 0 0 0) 0x7f3dfc0764e0 con 0x7f3de80744b0 2024-04-25T15:20:46.464 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f3de80744b0 msgr2=0x7f3de80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f3de80744b0 0x7f3de80769c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3dec033000 tx=0x7f3dec009000 comp rx=0 tx=0).stop 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06dfd0 msgr2=0x7f3dfc144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06dfd0 0x7f3dfc144760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d600 tx=0x7f3df000dac0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 shutdown_connections 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f3de80744b0 0x7f3de80769c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3dfc06f320 0x7f3dfc1418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dfc06dfd0 0x7f3dfc144760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 --2- 172.21.15.33:0/1227701751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3dfc06dbc0 0x7f3dfc1df330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 >> 172.21.15.33:0/1227701751 conn(0x7f3dfc063ad0 msgr2=0x7f3dfc1491b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:46.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 shutdown_connections 2024-04-25T15:20:46.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.462+0000 7f3e03ff3640 1 -- 172.21.15.33:0/1227701751 wait complete. 2024-04-25T15:20:46.475 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T15:20:45.705682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.321947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405573+0000","last_change":"2024-04-25T15:20:42.418715+0000","last_active":"2024-04-25T15:20:43.405573+0000","last_peered":"2024-04-25T15:20:43.405573+0000","last_clean":"2024-04-25T15:20:43.405573+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:20:43.405573+0000","last_undegraded":"2024-04-25T15:20:43.405573+0000","last_fullsized":"2024-04-25T15:20:43.405573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.236522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401337+0000","last_change":"2024-04-25T15:20:42.417722+0000","last_active":"2024-04-25T15:20:43.401337+0000","last_peered":"2024-04-25T15:20:43.401337+0000","last_clean":"2024-04-25T15:20:43.401337+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:20:43.401337+0000","last_undegraded":"2024-04-25T15:20:43.401337+0000","last_fullsized":"2024-04-25T15:20:43.401337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616831+0000","last_change":"2024-04-25T15:20:42.414889+0000","last_active":"2024-04-25T15:20:43.616831+0000","last_peered":"2024-04-25T15:20:43.616831+0000","last_clean":"2024-04-25T15:20:43.616831+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:20:43.616831+0000","last_undegraded":"2024-04-25T15:20:43.616831+0000","last_fullsized":"2024-04-25T15:20:43.616831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616592+0000","last_change":"2024-04-25T15:20:42.423112+0000","last_active":"2024-04-25T15:20:43.616592+0000","last_peered":"2024-04-25T15:20:43.616592+0000","last_clean":"2024-04-25T15:20:43.616592+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:20:43.616592+0000","last_undegraded":"2024-04-25T15:20:43.616592+0000","last_fullsized":"2024-04-25T15:20:43.616592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.236522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406049+0000","last_change":"2024-04-25T15:20:42.417398+0000","last_active":"2024-04-25T15:20:43.406049+0000","last_peered":"2024-04-25T15:20:43.406049+0000","last_clean":"2024-04-25T15:20:43.406049+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:20:43.406049+0000","last_undegraded":"2024-04-25T15:20:43.406049+0000","last_fullsized":"2024-04-25T15:20:43.406049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:26.290972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616266+0000","last_change":"2024-04-25T15:20:42.424408+0000","last_active":"2024-04-25T15:20:43.616266+0000","last_peered":"2024-04-25T15:20:43.616266+0000","last_clean":"2024-04-25T15:20:43.616266+0000","last_became_active":"2024-04-25T15:20:42.423560+0000","last_became_peered":"2024-04-25T15:20:42.423560+0000","last_unstale":"2024-04-25T15:20:43.616266+0000","last_undegraded":"2024-04-25T15:20:43.616266+0000","last_fullsized":"2024-04-25T15:20:43.616266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404956+0000","last_change":"2024-04-25T15:20:42.413800+0000","last_active":"2024-04-25T15:20:43.404956+0000","last_peered":"2024-04-25T15:20:43.404956+0000","last_clean":"2024-04-25T15:20:43.404956+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:20:43.404956+0000","last_undegraded":"2024-04-25T15:20:43.404956+0000","last_fullsized":"2024-04-25T15:20:43.404956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615647+0000","last_change":"2024-04-25T15:20:42.431896+0000","last_active":"2024-04-25T15:20:43.615647+0000","last_peered":"2024-04-25T15:20:43.615647+0000","last_clean":"2024-04-25T15:20:43.615647+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:20:43.615647+0000","last_undegraded":"2024-04-25T15:20:43.615647+0000","last_fullsized":"2024-04-25T15:20:43.615647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405749+0000","last_change":"2024-04-25T15:20:42.420423+0000","last_active":"2024-04-25T15:20:43.405749+0000","last_peered":"2024-04-25T15:20:43.405749+0000","last_clean":"2024-04-25T15:20:43.405749+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:20:43.405749+0000","last_undegraded":"2024-04-25T15:20:43.405749+0000","last_fullsized":"2024-04-25T15:20:43.405749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:41.305637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616917+0000","last_change":"2024-04-25T15:20:42.428177+0000","last_active":"2024-04-25T15:20:43.616917+0000","last_peered":"2024-04-25T15:20:43.616917+0000","last_clean":"2024-04-25T15:20:43.616917+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:20:43.616917+0000","last_undegraded":"2024-04-25T15:20:43.616917+0000","last_fullsized":"2024-04-25T15:20:43.616917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616285+0000","last_change":"2024-04-25T15:20:42.420688+0000","last_active":"2024-04-25T15:20:43.616285+0000","last_peered":"2024-04-25T15:20:43.616285+0000","last_clean":"2024-04-25T15:20:43.616285+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:20:43.616285+0000","last_undegraded":"2024-04-25T15:20:43.616285+0000","last_fullsized":"2024-04-25T15:20:43.616285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405959+0000","last_change":"2024-04-25T15:20:42.412698+0000","last_active":"2024-04-25T15:20:43.405959+0000","last_peered":"2024-04-25T15:20:43.405959+0000","last_clean":"2024-04-25T15:20:43.405959+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:20:43.405959+0000","last_undegraded":"2024-04-25T15:20:43.405959+0000","last_fullsized":"2024-04-25T15:20:43.405959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:21.373351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616977+0000","last_change":"2024-04-25T15:20:42.427925+0000","last_active":"2024-04-25T15:20:43.616977+0000","last_peered":"2024-04-25T15:20:43.616977+0000","last_clean":"2024-04-25T15:20:43.616977+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:20:43.616977+0000","last_undegraded":"2024-04-25T15:20:43.616977+0000","last_fullsized":"2024-04-25T15:20:43.616977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616364+0000","last_change":"2024-04-25T15:20:42.417743+0000","last_active":"2024-04-25T15:20:43.616364+0000","last_peered":"2024-04-25T15:20:43.616364+0000","last_clean":"2024-04-25T15:20:43.616364+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:20:43.616364+0000","last_undegraded":"2024-04-25T15:20:43.616364+0000","last_fullsized":"2024-04-25T15:20:43.616364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:45.392358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400983+0000","last_change":"2024-04-25T15:20:42.415903+0000","last_active":"2024-04-25T15:20:43.400983+0000","last_peered":"2024-04-25T15:20:43.400983+0000","last_clean":"2024-04-25T15:20:43.400983+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:20:43.400983+0000","last_undegraded":"2024-04-25T15:20:43.400983+0000","last_fullsized":"2024-04-25T15:20:43.400983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615637+0000","last_change":"2024-04-25T15:20:42.424790+0000","last_active":"2024-04-25T15:20:43.615637+0000","last_peered":"2024-04-25T15:20:43.615637+0000","last_clean":"2024-04-25T15:20:43.615637+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:20:43.615637+0000","last_undegraded":"2024-04-25T15:20:43.615637+0000","last_fullsized":"2024-04-25T15:20:43.615637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616578+0000","last_change":"2024-04-25T15:20:42.426982+0000","last_active":"2024-04-25T15:20:43.616578+0000","last_peered":"2024-04-25T15:20:43.616578+0000","last_clean":"2024-04-25T15:20:43.616578+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:20:43.616578+0000","last_undegraded":"2024-04-25T15:20:43.616578+0000","last_fullsized":"2024-04-25T15:20:43.616578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:08.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616451+0000","last_change":"2024-04-25T15:20:42.416175+0000","last_active":"2024-04-25T15:20:43.616451+0000","last_peered":"2024-04-25T15:20:43.616451+0000","last_clean":"2024-04-25T15:20:43.616451+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:20:43.616451+0000","last_undegraded":"2024-04-25T15:20:43.616451+0000","last_fullsized":"2024-04-25T15:20:43.616451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:12.712238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406285+0000","last_change":"2024-04-25T15:20:42.419392+0000","last_active":"2024-04-25T15:20:43.406285+0000","last_peered":"2024-04-25T15:20:43.406285+0000","last_clean":"2024-04-25T15:20:43.406285+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:20:43.406285+0000","last_undegraded":"2024-04-25T15:20:43.406285+0000","last_fullsized":"2024-04-25T15:20:43.406285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:14.498820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616583+0000","last_change":"2024-04-25T15:20:42.421681+0000","last_active":"2024-04-25T15:20:43.616583+0000","last_peered":"2024-04-25T15:20:43.616583+0000","last_clean":"2024-04-25T15:20:43.616583+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:20:43.616583+0000","last_undegraded":"2024-04-25T15:20:43.616583+0000","last_fullsized":"2024-04-25T15:20:43.616583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616401+0000","last_change":"2024-04-25T15:20:42.418252+0000","last_active":"2024-04-25T15:20:43.616401+0000","last_peered":"2024-04-25T15:20:43.616401+0000","last_clean":"2024-04-25T15:20:43.616401+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:20:43.616401+0000","last_undegraded":"2024-04-25T15:20:43.616401+0000","last_fullsized":"2024-04-25T15:20:43.616401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616126+0000","last_change":"2024-04-25T15:20:42.428193+0000","last_active":"2024-04-25T15:20:43.616126+0000","last_peered":"2024-04-25T15:20:43.616126+0000","last_clean":"2024-04-25T15:20:43.616126+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:20:43.616126+0000","last_undegraded":"2024-04-25T15:20:43.616126+0000","last_fullsized":"2024-04-25T15:20:43.616126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:34.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616784+0000","last_change":"2024-04-25T15:20:42.422940+0000","last_active":"2024-04-25T15:20:43.616784+0000","last_peered":"2024-04-25T15:20:43.616784+0000","last_clean":"2024-04-25T15:20:43.616784+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:20:43.616784+0000","last_undegraded":"2024-04-25T15:20:43.616784+0000","last_fullsized":"2024-04-25T15:20:43.616784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615727+0000","last_change":"2024-04-25T15:20:42.424516+0000","last_active":"2024-04-25T15:20:43.615727+0000","last_peered":"2024-04-25T15:20:43.615727+0000","last_clean":"2024-04-25T15:20:43.615727+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:20:43.615727+0000","last_undegraded":"2024-04-25T15:20:43.615727+0000","last_fullsized":"2024-04-25T15:20:43.615727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616785+0000","last_change":"2024-04-25T15:20:42.427631+0000","last_active":"2024-04-25T15:20:43.616785+0000","last_peered":"2024-04-25T15:20:43.616785+0000","last_clean":"2024-04-25T15:20:43.616785+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:20:43.616785+0000","last_undegraded":"2024-04-25T15:20:43.616785+0000","last_fullsized":"2024-04-25T15:20:43.616785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.617047+0000","last_change":"2024-04-25T15:20:42.425058+0000","last_active":"2024-04-25T15:20:43.617047+0000","last_peered":"2024-04-25T15:20:43.617047+0000","last_clean":"2024-04-25T15:20:43.617047+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:20:43.617047+0000","last_undegraded":"2024-04-25T15:20:43.617047+0000","last_fullsized":"2024-04-25T15:20:43.617047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401101+0000","last_change":"2024-04-25T15:20:42.428962+0000","last_active":"2024-04-25T15:20:43.401101+0000","last_peered":"2024-04-25T15:20:43.401101+0000","last_clean":"2024-04-25T15:20:43.401101+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:20:43.401101+0000","last_undegraded":"2024-04-25T15:20:43.401101+0000","last_fullsized":"2024-04-25T15:20:43.401101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616796+0000","last_change":"2024-04-25T15:20:42.428532+0000","last_active":"2024-04-25T15:20:43.616796+0000","last_peered":"2024-04-25T15:20:43.616796+0000","last_clean":"2024-04-25T15:20:43.616796+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:20:43.616796+0000","last_undegraded":"2024-04-25T15:20:43.616796+0000","last_fullsized":"2024-04-25T15:20:43.616796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616591+0000","last_change":"2024-04-25T15:20:42.422835+0000","last_active":"2024-04-25T15:20:43.616591+0000","last_peered":"2024-04-25T15:20:43.616591+0000","last_clean":"2024-04-25T15:20:43.616591+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:20:43.616591+0000","last_undegraded":"2024-04-25T15:20:43.616591+0000","last_fullsized":"2024-04-25T15:20:43.616591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616308+0000","last_change":"2024-04-25T15:20:42.424071+0000","last_active":"2024-04-25T15:20:43.616308+0000","last_peered":"2024-04-25T15:20:43.616308+0000","last_clean":"2024-04-25T15:20:43.616308+0000","last_became_active":"2024-04-25T15:20:42.423222+0000","last_became_peered":"2024-04-25T15:20:42.423222+0000","last_unstale":"2024-04-25T15:20:43.616308+0000","last_undegraded":"2024-04-25T15:20:43.616308+0000","last_fullsized":"2024-04-25T15:20:43.616308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:35.713134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615633+0000","last_change":"2024-04-25T15:20:42.430516+0000","last_active":"2024-04-25T15:20:43.615633+0000","last_peered":"2024-04-25T15:20:43.615633+0000","last_clean":"2024-04-25T15:20:43.615633+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:20:43.615633+0000","last_undegraded":"2024-04-25T15:20:43.615633+0000","last_fullsized":"2024-04-25T15:20:43.615633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:03.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615705+0000","last_change":"2024-04-25T15:20:42.418805+0000","last_active":"2024-04-25T15:20:43.615705+0000","last_peered":"2024-04-25T15:20:43.615705+0000","last_clean":"2024-04-25T15:20:43.615705+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:20:43.615705+0000","last_undegraded":"2024-04-25T15:20:43.615705+0000","last_fullsized":"2024-04-25T15:20:43.615705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406202+0000","last_change":"2024-04-25T15:20:42.418203+0000","last_active":"2024-04-25T15:20:43.406202+0000","last_peered":"2024-04-25T15:20:43.406202+0000","last_clean":"2024-04-25T15:20:43.406202+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:20:43.406202+0000","last_undegraded":"2024-04-25T15:20:43.406202+0000","last_fullsized":"2024-04-25T15:20:43.406202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:12.712238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616620+0000","last_change":"2024-04-25T15:20:41.411834+0000","last_active":"2024-04-25T15:20:43.616620+0000","last_peered":"2024-04-25T15:20:43.616620+0000","last_clean":"2024-04-25T15:20:43.616620+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:20:43.616620+0000","last_undegraded":"2024-04-25T15:20:43.616620+0000","last_fullsized":"2024-04-25T15:20:43.616620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616907+0000","last_change":"2024-04-25T15:20:42.412522+0000","last_active":"2024-04-25T15:20:43.616907+0000","last_peered":"2024-04-25T15:20:43.616907+0000","last_clean":"2024-04-25T15:20:43.616907+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:20:43.616907+0000","last_undegraded":"2024-04-25T15:20:43.616907+0000","last_fullsized":"2024-04-25T15:20:43.616907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616024+0000","last_change":"2024-04-25T15:20:41.401581+0000","last_active":"2024-04-25T15:20:43.616024+0000","last_peered":"2024-04-25T15:20:43.616024+0000","last_clean":"2024-04-25T15:20:43.616024+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:20:43.616024+0000","last_undegraded":"2024-04-25T15:20:43.616024+0000","last_fullsized":"2024-04-25T15:20:43.616024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615982+0000","last_change":"2024-04-25T15:20:41.404692+0000","last_active":"2024-04-25T15:20:43.615982+0000","last_peered":"2024-04-25T15:20:43.615982+0000","last_clean":"2024-04-25T15:20:43.615982+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:20:43.615982+0000","last_undegraded":"2024-04-25T15:20:43.615982+0000","last_fullsized":"2024-04-25T15:20:43.615982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615787+0000","last_change":"2024-04-25T15:20:42.413772+0000","last_active":"2024-04-25T15:20:43.615787+0000","last_peered":"2024-04-25T15:20:43.615787+0000","last_clean":"2024-04-25T15:20:43.615787+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:20:43.615787+0000","last_undegraded":"2024-04-25T15:20:43.615787+0000","last_fullsized":"2024-04-25T15:20:43.615787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615953+0000","last_change":"2024-04-25T15:20:41.406208+0000","last_active":"2024-04-25T15:20:43.615953+0000","last_peered":"2024-04-25T15:20:43.615953+0000","last_clean":"2024-04-25T15:20:43.615953+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:20:43.615953+0000","last_undegraded":"2024-04-25T15:20:43.615953+0000","last_fullsized":"2024-04-25T15:20:43.615953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400977+0000","last_change":"2024-04-25T15:20:42.427938+0000","last_active":"2024-04-25T15:20:43.400977+0000","last_peered":"2024-04-25T15:20:43.400977+0000","last_clean":"2024-04-25T15:20:43.400977+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:20:43.400977+0000","last_undegraded":"2024-04-25T15:20:43.400977+0000","last_fullsized":"2024-04-25T15:20:43.400977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616877+0000","last_change":"2024-04-25T15:20:41.406067+0000","last_active":"2024-04-25T15:20:43.616877+0000","last_peered":"2024-04-25T15:20:43.616877+0000","last_clean":"2024-04-25T15:20:43.616877+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:20:43.616877+0000","last_undegraded":"2024-04-25T15:20:43.616877+0000","last_fullsized":"2024-04-25T15:20:43.616877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616134+0000","last_change":"2024-04-25T15:20:42.426143+0000","last_active":"2024-04-25T15:20:43.616134+0000","last_peered":"2024-04-25T15:20:43.616134+0000","last_clean":"2024-04-25T15:20:43.616134+0000","last_became_active":"2024-04-25T15:20:42.425823+0000","last_became_peered":"2024-04-25T15:20:42.425823+0000","last_unstale":"2024-04-25T15:20:43.616134+0000","last_undegraded":"2024-04-25T15:20:43.616134+0000","last_fullsized":"2024-04-25T15:20:43.616134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616252+0000","last_change":"2024-04-25T15:20:41.410325+0000","last_active":"2024-04-25T15:20:43.616252+0000","last_peered":"2024-04-25T15:20:43.616252+0000","last_clean":"2024-04-25T15:20:43.616252+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:20:43.616252+0000","last_undegraded":"2024-04-25T15:20:43.616252+0000","last_fullsized":"2024-04-25T15:20:43.616252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.617013+0000","last_change":"2024-04-25T15:20:42.423079+0000","last_active":"2024-04-25T15:20:43.617013+0000","last_peered":"2024-04-25T15:20:43.617013+0000","last_clean":"2024-04-25T15:20:43.617013+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:20:43.617013+0000","last_undegraded":"2024-04-25T15:20:43.617013+0000","last_fullsized":"2024-04-25T15:20:43.617013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401225+0000","last_change":"2024-04-25T15:20:41.415893+0000","last_active":"2024-04-25T15:20:43.401225+0000","last_peered":"2024-04-25T15:20:43.401225+0000","last_clean":"2024-04-25T15:20:43.401225+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:20:43.401225+0000","last_undegraded":"2024-04-25T15:20:43.401225+0000","last_fullsized":"2024-04-25T15:20:43.401225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406160+0000","last_change":"2024-04-25T15:20:42.415485+0000","last_active":"2024-04-25T15:20:43.406160+0000","last_peered":"2024-04-25T15:20:43.406160+0000","last_clean":"2024-04-25T15:20:43.406160+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:20:43.406160+0000","last_undegraded":"2024-04-25T15:20:43.406160+0000","last_fullsized":"2024-04-25T15:20:43.406160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:03.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616702+0000","last_change":"2024-04-25T15:20:41.406750+0000","last_active":"2024-04-25T15:20:43.616702+0000","last_peered":"2024-04-25T15:20:43.616702+0000","last_clean":"2024-04-25T15:20:43.616702+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:20:43.616702+0000","last_undegraded":"2024-04-25T15:20:43.616702+0000","last_fullsized":"2024-04-25T15:20:43.616702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404818+0000","last_change":"2024-04-25T15:20:42.423197+0000","last_active":"2024-04-25T15:20:43.404818+0000","last_peered":"2024-04-25T15:20:43.404818+0000","last_clean":"2024-04-25T15:20:43.404818+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:20:43.404818+0000","last_undegraded":"2024-04-25T15:20:43.404818+0000","last_fullsized":"2024-04-25T15:20:43.404818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616717+0000","last_change":"2024-04-25T15:20:41.401705+0000","last_active":"2024-04-25T15:20:43.616717+0000","last_peered":"2024-04-25T15:20:43.616717+0000","last_clean":"2024-04-25T15:20:43.616717+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:20:43.616717+0000","last_undegraded":"2024-04-25T15:20:43.616717+0000","last_fullsized":"2024-04-25T15:20:43.616717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616538+0000","last_change":"2024-04-25T15:20:42.416896+0000","last_active":"2024-04-25T15:20:43.616538+0000","last_peered":"2024-04-25T15:20:43.616538+0000","last_clean":"2024-04-25T15:20:43.616538+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:20:43.616538+0000","last_undegraded":"2024-04-25T15:20:43.616538+0000","last_fullsized":"2024-04-25T15:20:43.616538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616404+0000","last_change":"2024-04-25T15:20:41.409212+0000","last_active":"2024-04-25T15:20:43.616404+0000","last_peered":"2024-04-25T15:20:43.616404+0000","last_clean":"2024-04-25T15:20:43.616404+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:20:43.616404+0000","last_undegraded":"2024-04-25T15:20:43.616404+0000","last_fullsized":"2024-04-25T15:20:43.616404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406079+0000","last_change":"2024-04-25T15:20:42.412386+0000","last_active":"2024-04-25T15:20:43.406079+0000","last_peered":"2024-04-25T15:20:43.406079+0000","last_clean":"2024-04-25T15:20:43.406079+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:20:43.406079+0000","last_undegraded":"2024-04-25T15:20:43.406079+0000","last_fullsized":"2024-04-25T15:20:43.406079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:16.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615809+0000","last_change":"2024-04-25T15:20:41.402015+0000","last_active":"2024-04-25T15:20:43.615809+0000","last_peered":"2024-04-25T15:20:43.615809+0000","last_clean":"2024-04-25T15:20:43.615809+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:20:43.615809+0000","last_undegraded":"2024-04-25T15:20:43.615809+0000","last_fullsized":"2024-04-25T15:20:43.615809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615723+0000","last_change":"2024-04-25T15:20:42.418565+0000","last_active":"2024-04-25T15:20:43.615723+0000","last_peered":"2024-04-25T15:20:43.615723+0000","last_clean":"2024-04-25T15:20:43.615723+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:20:43.615723+0000","last_undegraded":"2024-04-25T15:20:43.615723+0000","last_fullsized":"2024-04-25T15:20:43.615723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615665+0000","last_change":"2024-04-25T15:20:41.408427+0000","last_active":"2024-04-25T15:20:43.615665+0000","last_peered":"2024-04-25T15:20:43.615665+0000","last_clean":"2024-04-25T15:20:43.615665+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:20:43.615665+0000","last_undegraded":"2024-04-25T15:20:43.615665+0000","last_fullsized":"2024-04-25T15:20:43.615665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405200+0000","last_change":"2024-04-25T15:20:42.415542+0000","last_active":"2024-04-25T15:20:43.405200+0000","last_peered":"2024-04-25T15:20:43.405200+0000","last_clean":"2024-04-25T15:20:43.405200+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:20:43.405200+0000","last_undegraded":"2024-04-25T15:20:43.405200+0000","last_fullsized":"2024-04-25T15:20:43.405200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:08.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405718+0000","last_change":"2024-04-25T15:20:41.405515+0000","last_active":"2024-04-25T15:20:43.405718+0000","last_peered":"2024-04-25T15:20:43.405718+0000","last_clean":"2024-04-25T15:20:43.405718+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:20:43.405718+0000","last_undegraded":"2024-04-25T15:20:43.405718+0000","last_fullsized":"2024-04-25T15:20:43.405718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406362+0000","last_change":"2024-04-25T15:20:42.412473+0000","last_active":"2024-04-25T15:20:43.406362+0000","last_peered":"2024-04-25T15:20:43.406362+0000","last_clean":"2024-04-25T15:20:43.406362+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:20:43.406362+0000","last_undegraded":"2024-04-25T15:20:43.406362+0000","last_fullsized":"2024-04-25T15:20:43.406362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:37.101862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616569+0000","last_change":"2024-04-25T15:20:41.406806+0000","last_active":"2024-04-25T15:20:43.616569+0000","last_peered":"2024-04-25T15:20:43.616569+0000","last_clean":"2024-04-25T15:20:43.616569+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:20:43.616569+0000","last_undegraded":"2024-04-25T15:20:43.616569+0000","last_fullsized":"2024-04-25T15:20:43.616569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405950+0000","last_change":"2024-04-25T15:20:42.414216+0000","last_active":"2024-04-25T15:20:43.405950+0000","last_peered":"2024-04-25T15:20:43.405950+0000","last_clean":"2024-04-25T15:20:43.405950+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:20:43.405950+0000","last_undegraded":"2024-04-25T15:20:43.405950+0000","last_fullsized":"2024-04-25T15:20:43.405950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:11.295712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401342+0000","last_change":"2024-04-25T15:20:41.410562+0000","last_active":"2024-04-25T15:20:43.401342+0000","last_peered":"2024-04-25T15:20:43.401342+0000","last_clean":"2024-04-25T15:20:43.401342+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:20:43.401342+0000","last_undegraded":"2024-04-25T15:20:43.401342+0000","last_fullsized":"2024-04-25T15:20:43.401342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616931+0000","last_change":"2024-04-25T15:20:42.424064+0000","last_active":"2024-04-25T15:20:43.616931+0000","last_peered":"2024-04-25T15:20:43.616931+0000","last_clean":"2024-04-25T15:20:43.616931+0000","last_became_active":"2024-04-25T15:20:42.422759+0000","last_became_peered":"2024-04-25T15:20:42.422759+0000","last_unstale":"2024-04-25T15:20:43.616931+0000","last_undegraded":"2024-04-25T15:20:43.616931+0000","last_fullsized":"2024-04-25T15:20:43.616931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:16.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615991+0000","last_change":"2024-04-25T15:20:41.404065+0000","last_active":"2024-04-25T15:20:43.615991+0000","last_peered":"2024-04-25T15:20:43.615991+0000","last_clean":"2024-04-25T15:20:43.615991+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:20:43.615991+0000","last_undegraded":"2024-04-25T15:20:43.615991+0000","last_fullsized":"2024-04-25T15:20:43.615991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405069+0000","last_change":"2024-04-25T15:20:42.422505+0000","last_active":"2024-04-25T15:20:43.405069+0000","last_peered":"2024-04-25T15:20:43.405069+0000","last_clean":"2024-04-25T15:20:43.405069+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:20:43.405069+0000","last_undegraded":"2024-04-25T15:20:43.405069+0000","last_fullsized":"2024-04-25T15:20:43.405069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:35.713134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404763+0000","last_change":"2024-04-25T15:20:30.873208+0000","last_active":"2024-04-25T15:20:43.404763+0000","last_peered":"2024-04-25T15:20:43.404763+0000","last_clean":"2024-04-25T15:20:43.404763+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:20:43.404763+0000","last_undegraded":"2024-04-25T15:20:43.404763+0000","last_fullsized":"2024-04-25T15:20:43.404763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_clean_scrub_stamp":"2024-04-25T15:20:29.835147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:59.356200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615795+0000","last_change":"2024-04-25T15:20:41.403922+0000","last_active":"2024-04-25T15:20:43.615795+0000","last_peered":"2024-04-25T15:20:43.615795+0000","last_clean":"2024-04-25T15:20:43.615795+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:20:43.615795+0000","last_undegraded":"2024-04-25T15:20:43.615795+0000","last_fullsized":"2024-04-25T15:20:43.615795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616811+0000","last_change":"2024-04-25T15:20:42.432737+0000","last_active":"2024-04-25T15:20:43.616811+0000","last_peered":"2024-04-25T15:20:43.616811+0000","last_clean":"2024-04-25T15:20:43.616811+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:20:43.616811+0000","last_undegraded":"2024-04-25T15:20:43.616811+0000","last_fullsized":"2024-04-25T15:20:43.616811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:34.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405238+0000","last_change":"2024-04-25T15:20:41.410568+0000","last_active":"2024-04-25T15:20:43.405238+0000","last_peered":"2024-04-25T15:20:43.405238+0000","last_clean":"2024-04-25T15:20:43.405238+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:20:43.405238+0000","last_undegraded":"2024-04-25T15:20:43.405238+0000","last_fullsized":"2024-04-25T15:20:43.405238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616090+0000","last_change":"2024-04-25T15:20:42.410449+0000","last_active":"2024-04-25T15:20:43.616090+0000","last_peered":"2024-04-25T15:20:43.616090+0000","last_clean":"2024-04-25T15:20:43.616090+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:20:43.616090+0000","last_undegraded":"2024-04-25T15:20:43.616090+0000","last_fullsized":"2024-04-25T15:20:43.616090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:01.422318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615696+0000","last_change":"2024-04-25T15:20:41.406046+0000","last_active":"2024-04-25T15:20:43.615696+0000","last_peered":"2024-04-25T15:20:43.615696+0000","last_clean":"2024-04-25T15:20:43.615696+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:20:43.615696+0000","last_undegraded":"2024-04-25T15:20:43.615696+0000","last_fullsized":"2024-04-25T15:20:43.615696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400998+0000","last_change":"2024-04-25T15:20:42.419446+0000","last_active":"2024-04-25T15:20:43.400998+0000","last_peered":"2024-04-25T15:20:43.400998+0000","last_clean":"2024-04-25T15:20:43.400998+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:20:43.400998+0000","last_undegraded":"2024-04-25T15:20:43.400998+0000","last_fullsized":"2024-04-25T15:20:43.400998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616445+0000","last_change":"2024-04-25T15:20:41.410676+0000","last_active":"2024-04-25T15:20:43.616445+0000","last_peered":"2024-04-25T15:20:43.616445+0000","last_clean":"2024-04-25T15:20:43.616445+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:20:43.616445+0000","last_undegraded":"2024-04-25T15:20:43.616445+0000","last_fullsized":"2024-04-25T15:20:43.616445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405821+0000","last_change":"2024-04-25T15:20:42.406333+0000","last_active":"2024-04-25T15:20:43.405821+0000","last_peered":"2024-04-25T15:20:43.405821+0000","last_clean":"2024-04-25T15:20:43.405821+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:20:43.405821+0000","last_undegraded":"2024-04-25T15:20:43.405821+0000","last_fullsized":"2024-04-25T15:20:43.405821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:33.466178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401234+0000","last_change":"2024-04-25T15:20:41.413703+0000","last_active":"2024-04-25T15:20:43.401234+0000","last_peered":"2024-04-25T15:20:43.401234+0000","last_clean":"2024-04-25T15:20:43.401234+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:20:43.401234+0000","last_undegraded":"2024-04-25T15:20:43.401234+0000","last_fullsized":"2024-04-25T15:20:43.401234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616898+0000","last_change":"2024-04-25T15:20:42.424028+0000","last_active":"2024-04-25T15:20:43.616898+0000","last_peered":"2024-04-25T15:20:43.616898+0000","last_clean":"2024-04-25T15:20:43.616898+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:20:43.616898+0000","last_undegraded":"2024-04-25T15:20:43.616898+0000","last_fullsized":"2024-04-25T15:20:43.616898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:26.290972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406206+0000","last_change":"2024-04-25T15:20:41.408759+0000","last_active":"2024-04-25T15:20:43.406206+0000","last_peered":"2024-04-25T15:20:43.406206+0000","last_clean":"2024-04-25T15:20:43.406206+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:20:43.406206+0000","last_undegraded":"2024-04-25T15:20:43.406206+0000","last_fullsized":"2024-04-25T15:20:43.406206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:41.992733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401262+0000","last_change":"2024-04-25T15:20:42.418890+0000","last_active":"2024-04-25T15:20:43.401262+0000","last_peered":"2024-04-25T15:20:43.401262+0000","last_clean":"2024-04-25T15:20:43.401262+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:20:43.401262+0000","last_undegraded":"2024-04-25T15:20:43.401262+0000","last_fullsized":"2024-04-25T15:20:43.401262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:44.420974+0000","last_change":"2024-04-25T15:20:41.409877+0000","last_active":"2024-04-25T15:20:44.420974+0000","last_peered":"2024-04-25T15:20:44.420974+0000","last_clean":"2024-04-25T15:20:44.420974+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:20:44.420974+0000","last_undegraded":"2024-04-25T15:20:44.420974+0000","last_fullsized":"2024-04-25T15:20:44.420974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616942+0000","last_change":"2024-04-25T15:20:42.428777+0000","last_active":"2024-04-25T15:20:43.616942+0000","last_peered":"2024-04-25T15:20:43.616942+0000","last_clean":"2024-04-25T15:20:43.616942+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:20:43.616942+0000","last_undegraded":"2024-04-25T15:20:43.616942+0000","last_fullsized":"2024-04-25T15:20:43.616942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616981+0000","last_change":"2024-04-25T15:20:41.410949+0000","last_active":"2024-04-25T15:20:43.616981+0000","last_peered":"2024-04-25T15:20:43.616981+0000","last_clean":"2024-04-25T15:20:43.616981+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:20:43.616981+0000","last_undegraded":"2024-04-25T15:20:43.616981+0000","last_fullsized":"2024-04-25T15:20:43.616981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616443+0000","last_change":"2024-04-25T15:20:42.413542+0000","last_active":"2024-04-25T15:20:43.616443+0000","last_peered":"2024-04-25T15:20:43.616443+0000","last_clean":"2024-04-25T15:20:43.616443+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:20:43.616443+0000","last_undegraded":"2024-04-25T15:20:43.616443+0000","last_fullsized":"2024-04-25T15:20:43.616443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404657+0000","last_change":"2024-04-25T15:20:41.405078+0000","last_active":"2024-04-25T15:20:43.404657+0000","last_peered":"2024-04-25T15:20:43.404657+0000","last_clean":"2024-04-25T15:20:43.404657+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:20:43.404657+0000","last_undegraded":"2024-04-25T15:20:43.404657+0000","last_fullsized":"2024-04-25T15:20:43.404657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406027+0000","last_change":"2024-04-25T15:20:42.413408+0000","last_active":"2024-04-25T15:20:43.406027+0000","last_peered":"2024-04-25T15:20:43.406027+0000","last_clean":"2024-04-25T15:20:43.406027+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:20:43.406027+0000","last_undegraded":"2024-04-25T15:20:43.406027+0000","last_fullsized":"2024-04-25T15:20:43.406027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:37.360885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401097+0000","last_change":"2024-04-25T15:20:41.411766+0000","last_active":"2024-04-25T15:20:43.401097+0000","last_peered":"2024-04-25T15:20:43.401097+0000","last_clean":"2024-04-25T15:20:43.401097+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:20:43.401097+0000","last_undegraded":"2024-04-25T15:20:43.401097+0000","last_fullsized":"2024-04-25T15:20:43.401097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616281+0000","last_change":"2024-04-25T15:20:42.417444+0000","last_active":"2024-04-25T15:20:43.616281+0000","last_peered":"2024-04-25T15:20:43.616281+0000","last_clean":"2024-04-25T15:20:43.616281+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:20:43.616281+0000","last_undegraded":"2024-04-25T15:20:43.616281+0000","last_fullsized":"2024-04-25T15:20:43.616281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401096+0000","last_change":"2024-04-25T15:20:41.406926+0000","last_active":"2024-04-25T15:20:43.401096+0000","last_peered":"2024-04-25T15:20:43.401096+0000","last_clean":"2024-04-25T15:20:43.401096+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:20:43.401096+0000","last_undegraded":"2024-04-25T15:20:43.401096+0000","last_fullsized":"2024-04-25T15:20:43.401096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616486+0000","last_change":"2024-04-25T15:20:42.422510+0000","last_active":"2024-04-25T15:20:43.616486+0000","last_peered":"2024-04-25T15:20:43.616486+0000","last_clean":"2024-04-25T15:20:43.616486+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:20:43.616486+0000","last_undegraded":"2024-04-25T15:20:43.616486+0000","last_fullsized":"2024-04-25T15:20:43.616486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406194+0000","last_change":"2024-04-25T15:20:41.408140+0000","last_active":"2024-04-25T15:20:43.406194+0000","last_peered":"2024-04-25T15:20:43.406194+0000","last_clean":"2024-04-25T15:20:43.406194+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:20:43.406194+0000","last_undegraded":"2024-04-25T15:20:43.406194+0000","last_fullsized":"2024-04-25T15:20:43.406194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615884+0000","last_change":"2024-04-25T15:20:42.421911+0000","last_active":"2024-04-25T15:20:43.615884+0000","last_peered":"2024-04-25T15:20:43.615884+0000","last_clean":"2024-04-25T15:20:43.615884+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:20:43.615884+0000","last_undegraded":"2024-04-25T15:20:43.615884+0000","last_fullsized":"2024-04-25T15:20:43.615884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616795+0000","last_change":"2024-04-25T15:20:42.421340+0000","last_active":"2024-04-25T15:20:43.616795+0000","last_peered":"2024-04-25T15:20:43.616795+0000","last_clean":"2024-04-25T15:20:43.616795+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:20:43.616795+0000","last_undegraded":"2024-04-25T15:20:43.616795+0000","last_fullsized":"2024-04-25T15:20:43.616795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:11.295712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405091+0000","last_change":"2024-04-25T15:20:41.408459+0000","last_active":"2024-04-25T15:20:43.405091+0000","last_peered":"2024-04-25T15:20:43.405091+0000","last_clean":"2024-04-25T15:20:43.405091+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:20:43.405091+0000","last_undegraded":"2024-04-25T15:20:43.405091+0000","last_fullsized":"2024-04-25T15:20:43.405091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616609+0000","last_change":"2024-04-25T15:20:42.421601+0000","last_active":"2024-04-25T15:20:43.616609+0000","last_peered":"2024-04-25T15:20:43.616609+0000","last_clean":"2024-04-25T15:20:43.616609+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:20:43.616609+0000","last_undegraded":"2024-04-25T15:20:43.616609+0000","last_fullsized":"2024-04-25T15:20:43.616609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:41.305637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405989+0000","last_change":"2024-04-25T15:20:41.408914+0000","last_active":"2024-04-25T15:20:43.405989+0000","last_peered":"2024-04-25T15:20:43.405989+0000","last_clean":"2024-04-25T15:20:43.405989+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:20:43.405989+0000","last_undegraded":"2024-04-25T15:20:43.405989+0000","last_fullsized":"2024-04-25T15:20:43.405989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.598854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616433+0000","last_change":"2024-04-25T15:20:42.423383+0000","last_active":"2024-04-25T15:20:43.616433+0000","last_peered":"2024-04-25T15:20:43.616433+0000","last_clean":"2024-04-25T15:20:43.616433+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:20:43.616433+0000","last_undegraded":"2024-04-25T15:20:43.616433+0000","last_fullsized":"2024-04-25T15:20:43.616433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616854+0000","last_change":"2024-04-25T15:20:41.405976+0000","last_active":"2024-04-25T15:20:43.616854+0000","last_peered":"2024-04-25T15:20:43.616854+0000","last_clean":"2024-04-25T15:20:43.616854+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:20:43.616854+0000","last_undegraded":"2024-04-25T15:20:43.616854+0000","last_fullsized":"2024-04-25T15:20:43.616854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616697+0000","last_change":"2024-04-25T15:20:42.429601+0000","last_active":"2024-04-25T15:20:43.616697+0000","last_peered":"2024-04-25T15:20:43.616697+0000","last_clean":"2024-04-25T15:20:43.616697+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:20:43.616697+0000","last_undegraded":"2024-04-25T15:20:43.616697+0000","last_fullsized":"2024-04-25T15:20:43.616697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616853+0000","last_change":"2024-04-25T15:20:41.410750+0000","last_active":"2024-04-25T15:20:43.616853+0000","last_peered":"2024-04-25T15:20:43.616853+0000","last_clean":"2024-04-25T15:20:43.616853+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:20:43.616853+0000","last_undegraded":"2024-04-25T15:20:43.616853+0000","last_fullsized":"2024-04-25T15:20:43.616853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:20:46.479 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:20:46.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.625+0000 7fd4a65ce640 1 Processor -- start 2024-04-25T15:20:46.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.625+0000 7fd4a65ce640 1 -- start start 2024-04-25T15:20:46.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.626+0000 7fd4a65ce640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd4a00b9570 0x7fd4a006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.626+0000 7fd4a65ce640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd4a00ba490 0x7fd4a00be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.626+0000 7fd4a65ce640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4a00b99b0 con 0x7fd4a014cd40 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.626+0000 7fd4a65ce640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fd4a00b9c90 con 0x7fd4a00b9570 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.626+0000 7fd4a65ce640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd4a00b9f70 con 0x7fd4a00ba490 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd4a00b9570 0x7fd4a006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd4a00b9570 0x7fd4a006d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50984/0 (socket says 172.21.15.33:50984) 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49ffff640 1 -- 172.21.15.33:0/3623513608 learned_addr learned my addr 172.21.15.33:0/3623513608 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49f7fe640 1 --2- 172.21.15.33:0/3623513608 >> v2:172.21.15.155:3300/0 conn(0x7fd4a00ba490 0x7fd4a00be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49ffff640 1 -- 172.21.15.33:0/3623513608 >> v2:172.21.15.155:3300/0 conn(0x7fd4a00ba490 msgr2=0x7fd4a00be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49ffff640 1 --2- 172.21.15.33:0/3623513608 >> v2:172.21.15.155:3300/0 conn(0x7fd4a00ba490 0x7fd4a00be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49ffff640 1 -- 172.21.15.33:0/3623513608 >> v1:172.21.15.155:6789/0 conn(0x7fd4a014cd40 legacy=0x7fd4a009d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49ffff640 1 -- 172.21.15.33:0/3623513608 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a00be5b0 con 0x7fd4a00b9570 2024-04-25T15:20:46.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.627+0000 7fd49f7fe640 1 --2- 172.21.15.33:0/3623513608 >> v2:172.21.15.155:3300/0 conn(0x7fd4a00ba490 0x7fd4a00be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.628+0000 7fd49ffff640 1 --2- 172.21.15.33:0/3623513608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b9570 0x7fd4a006d230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd4a006f4a0 tx=0x7fd49402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380625f85735e019 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.628+0000 7fd49effd640 1 -- 172.21.15.33:0/3623513608 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494037070 con 0x7fd4a00b9570 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.628+0000 7fd49effd640 1 -- 172.21.15.33:0/3623513608 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd494032440 con 0x7fd4a00b9570 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.628+0000 7fd49effd640 1 -- 172.21.15.33:0/3623513608 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494032810 con 0x7fd4a00b9570 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.628+0000 7fd4a65ce640 1 -- 172.21.15.33:0/3623513608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b9570 msgr2=0x7fd4a006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.628+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/3623513608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b9570 0x7fd4a006d230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd4a006f4a0 tx=0x7fd49402a270 comp rx=0 tx=0).stop 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.629+0000 7fd4a65ce640 1 -- 172.21.15.33:0/3623513608 shutdown_connections 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.629+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/3623513608 >> v2:172.21.15.155:3300/0 conn(0x7fd4a00ba490 0x7fd4a00be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.629+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/3623513608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b9570 0x7fd4a006d230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.629+0000 7fd4a65ce640 1 -- 172.21.15.33:0/3623513608 >> 172.21.15.33:0/3623513608 conn(0x7fd4a00bebf0 msgr2=0x7fd4a00bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:46.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.629+0000 7fd4a65ce640 1 -- 172.21.15.33:0/3623513608 shutdown_connections 2024-04-25T15:20:46.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.629+0000 7fd4a65ce640 1 -- 172.21.15.33:0/3623513608 wait complete. 2024-04-25T15:20:46.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.630+0000 7fd4a65ce640 1 Processor -- start 2024-04-25T15:20:46.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.630+0000 7fd4a65ce640 1 -- start start 2024-04-25T15:20:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a65ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4a014cd40 0x7fd4a00b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a65ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4a00b84d0 0x7fd4a00b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a65ce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b1380 0x7fd4a01497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a65ce640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a014d2d0 con 0x7fd4a00b1380 2024-04-25T15:20:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a65ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a014d150 con 0x7fd4a00b84d0 2024-04-25T15:20:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a65ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a01540b0 con 0x7fd4a014cd40 2024-04-25T15:20:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a4b6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b1380 0x7fd4a01497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a4b6b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b1380 0x7fd4a01497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50994/0 (socket says 172.21.15.33:50994) 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.631+0000 7fd4a4b6b640 1 -- 172.21.15.33:0/4212697369 learned_addr learned my addr 172.21.15.33:0/4212697369 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd49ffff640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4a014cd40 0x7fd4a00b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd49f7fe640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4a00b84d0 0x7fd4a00b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd4a4b6b640 1 -- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4a014cd40 msgr2=0x7fd4a00b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd4a4b6b640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4a014cd40 0x7fd4a00b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd4a4b6b640 1 -- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4a00b84d0 msgr2=0x7fd4a00b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd4a4b6b640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4a00b84d0 0x7fd4a00b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd4a4b6b640 1 -- 172.21.15.33:0/4212697369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a00b6b40 con 0x7fd4a00b1380 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd4a4b6b640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b1380 0x7fd4a01497b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd49800c680 tx=0x7fd49800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd49cff9640 1 -- 172.21.15.33:0/4212697369 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498003b70 con 0x7fd4a00b1380 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd49cff9640 1 -- 172.21.15.33:0/4212697369 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd498003d10 con 0x7fd4a00b1380 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a00b6e20 con 0x7fd4a00b1380 2024-04-25T15:20:46.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd49cff9640 1 -- 172.21.15.33:0/4212697369 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd498005310 con 0x7fd4a00b1380 2024-04-25T15:20:46.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.632+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a00b88e0 con 0x7fd4a00b1380 2024-04-25T15:20:46.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.633+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a00b1790 con 0x7fd4a00b1380 2024-04-25T15:20:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.634+0000 7fd49cff9640 1 -- 172.21.15.33:0/4212697369 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd4980054b0 con 0x7fd4a00b1380 2024-04-25T15:20:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.634+0000 7fd49cff9640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd48c0744b0 0x7fd48c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.635+0000 7fd49cff9640 1 -- 172.21.15.33:0/4212697369 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd498094ff0 con 0x7fd4a00b1380 2024-04-25T15:20:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.635+0000 7fd49ffff640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd48c0744b0 0x7fd48c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.635+0000 7fd49ffff640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd48c0744b0 0x7fd48c0769c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd494034000 tx=0x7fd49402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:46.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.639+0000 7fd49cff9640 1 -- 172.21.15.33:0/4212697369 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd4a00b1790 con 0x7fd4a00b1380 2024-04-25T15:20:46.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.820+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4a0147200 con 0x7fd48c0744b0 2024-04-25T15:20:46.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.827+0000 7fd49cff9640 1 -- 172.21.15.33:0/4212697369 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251934 (secure 0 0 0) 0x7fd4a0147200 con 0x7fd48c0744b0 2024-04-25T15:20:46.831 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:46.832 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:20:46.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd48c0744b0 msgr2=0x7fd48c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.833 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd48c0744b0 0x7fd48c0769c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd494034000 tx=0x7fd49402e000 comp rx=0 tx=0).stop 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b1380 msgr2=0x7fd4a01497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b1380 0x7fd4a01497b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd49800c680 tx=0x7fd49800cb40 comp rx=0 tx=0).stop 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 shutdown_connections 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd48c0744b0 0x7fd48c0769c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4a00b1380 0x7fd4a01497b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4a00b84d0 0x7fd4a00b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 --2- 172.21.15.33:0/4212697369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4a014cd40 0x7fd4a00b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.829+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 >> 172.21.15.33:0/4212697369 conn(0x7fd4a00bebf0 msgr2=0x7fd4a00bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.830+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 shutdown_connections 2024-04-25T15:20:46.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.830+0000 7fd4a65ce640 1 -- 172.21.15.33:0/4212697369 wait complete. 2024-04-25T15:20:46.842 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T15:20:45.705682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.321947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405573+0000","last_change":"2024-04-25T15:20:42.418715+0000","last_active":"2024-04-25T15:20:43.405573+0000","last_peered":"2024-04-25T15:20:43.405573+0000","last_clean":"2024-04-25T15:20:43.405573+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:20:43.405573+0000","last_undegraded":"2024-04-25T15:20:43.405573+0000","last_fullsized":"2024-04-25T15:20:43.405573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.236522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401337+0000","last_change":"2024-04-25T15:20:42.417722+0000","last_active":"2024-04-25T15:20:43.401337+0000","last_peered":"2024-04-25T15:20:43.401337+0000","last_clean":"2024-04-25T15:20:43.401337+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:20:43.401337+0000","last_undegraded":"2024-04-25T15:20:43.401337+0000","last_fullsized":"2024-04-25T15:20:43.401337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616831+0000","last_change":"2024-04-25T15:20:42.414889+0000","last_active":"2024-04-25T15:20:43.616831+0000","last_peered":"2024-04-25T15:20:43.616831+0000","last_clean":"2024-04-25T15:20:43.616831+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:20:43.616831+0000","last_undegraded":"2024-04-25T15:20:43.616831+0000","last_fullsized":"2024-04-25T15:20:43.616831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616592+0000","last_change":"2024-04-25T15:20:42.423112+0000","last_active":"2024-04-25T15:20:43.616592+0000","last_peered":"2024-04-25T15:20:43.616592+0000","last_clean":"2024-04-25T15:20:43.616592+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:20:43.616592+0000","last_undegraded":"2024-04-25T15:20:43.616592+0000","last_fullsized":"2024-04-25T15:20:43.616592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.236522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406049+0000","last_change":"2024-04-25T15:20:42.417398+0000","last_active":"2024-04-25T15:20:43.406049+0000","last_peered":"2024-04-25T15:20:43.406049+0000","last_clean":"2024-04-25T15:20:43.406049+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:20:43.406049+0000","last_undegraded":"2024-04-25T15:20:43.406049+0000","last_fullsized":"2024-04-25T15:20:43.406049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:26.290972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616266+0000","last_change":"2024-04-25T15:20:42.424408+0000","last_active":"2024-04-25T15:20:43.616266+0000","last_peered":"2024-04-25T15:20:43.616266+0000","last_clean":"2024-04-25T15:20:43.616266+0000","last_became_active":"2024-04-25T15:20:42.423560+0000","last_became_peered":"2024-04-25T15:20:42.423560+0000","last_unstale":"2024-04-25T15:20:43.616266+0000","last_undegraded":"2024-04-25T15:20:43.616266+0000","last_fullsized":"2024-04-25T15:20:43.616266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404956+0000","last_change":"2024-04-25T15:20:42.413800+0000","last_active":"2024-04-25T15:20:43.404956+0000","last_peered":"2024-04-25T15:20:43.404956+0000","last_clean":"2024-04-25T15:20:43.404956+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:20:43.404956+0000","last_undegraded":"2024-04-25T15:20:43.404956+0000","last_fullsized":"2024-04-25T15:20:43.404956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615647+0000","last_change":"2024-04-25T15:20:42.431896+0000","last_active":"2024-04-25T15:20:43.615647+0000","last_peered":"2024-04-25T15:20:43.615647+0000","last_clean":"2024-04-25T15:20:43.615647+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:20:43.615647+0000","last_undegraded":"2024-04-25T15:20:43.615647+0000","last_fullsized":"2024-04-25T15:20:43.615647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405749+0000","last_change":"2024-04-25T15:20:42.420423+0000","last_active":"2024-04-25T15:20:43.405749+0000","last_peered":"2024-04-25T15:20:43.405749+0000","last_clean":"2024-04-25T15:20:43.405749+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:20:43.405749+0000","last_undegraded":"2024-04-25T15:20:43.405749+0000","last_fullsized":"2024-04-25T15:20:43.405749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:41.305637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616917+0000","last_change":"2024-04-25T15:20:42.428177+0000","last_active":"2024-04-25T15:20:43.616917+0000","last_peered":"2024-04-25T15:20:43.616917+0000","last_clean":"2024-04-25T15:20:43.616917+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:20:43.616917+0000","last_undegraded":"2024-04-25T15:20:43.616917+0000","last_fullsized":"2024-04-25T15:20:43.616917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616285+0000","last_change":"2024-04-25T15:20:42.420688+0000","last_active":"2024-04-25T15:20:43.616285+0000","last_peered":"2024-04-25T15:20:43.616285+0000","last_clean":"2024-04-25T15:20:43.616285+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:20:43.616285+0000","last_undegraded":"2024-04-25T15:20:43.616285+0000","last_fullsized":"2024-04-25T15:20:43.616285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405959+0000","last_change":"2024-04-25T15:20:42.412698+0000","last_active":"2024-04-25T15:20:43.405959+0000","last_peered":"2024-04-25T15:20:43.405959+0000","last_clean":"2024-04-25T15:20:43.405959+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:20:43.405959+0000","last_undegraded":"2024-04-25T15:20:43.405959+0000","last_fullsized":"2024-04-25T15:20:43.405959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:21.373351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616977+0000","last_change":"2024-04-25T15:20:42.427925+0000","last_active":"2024-04-25T15:20:43.616977+0000","last_peered":"2024-04-25T15:20:43.616977+0000","last_clean":"2024-04-25T15:20:43.616977+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:20:43.616977+0000","last_undegraded":"2024-04-25T15:20:43.616977+0000","last_fullsized":"2024-04-25T15:20:43.616977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616364+0000","last_change":"2024-04-25T15:20:42.417743+0000","last_active":"2024-04-25T15:20:43.616364+0000","last_peered":"2024-04-25T15:20:43.616364+0000","last_clean":"2024-04-25T15:20:43.616364+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:20:43.616364+0000","last_undegraded":"2024-04-25T15:20:43.616364+0000","last_fullsized":"2024-04-25T15:20:43.616364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:45.392358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400983+0000","last_change":"2024-04-25T15:20:42.415903+0000","last_active":"2024-04-25T15:20:43.400983+0000","last_peered":"2024-04-25T15:20:43.400983+0000","last_clean":"2024-04-25T15:20:43.400983+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:20:43.400983+0000","last_undegraded":"2024-04-25T15:20:43.400983+0000","last_fullsized":"2024-04-25T15:20:43.400983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615637+0000","last_change":"2024-04-25T15:20:42.424790+0000","last_active":"2024-04-25T15:20:43.615637+0000","last_peered":"2024-04-25T15:20:43.615637+0000","last_clean":"2024-04-25T15:20:43.615637+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:20:43.615637+0000","last_undegraded":"2024-04-25T15:20:43.615637+0000","last_fullsized":"2024-04-25T15:20:43.615637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616578+0000","last_change":"2024-04-25T15:20:42.426982+0000","last_active":"2024-04-25T15:20:43.616578+0000","last_peered":"2024-04-25T15:20:43.616578+0000","last_clean":"2024-04-25T15:20:43.616578+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:20:43.616578+0000","last_undegraded":"2024-04-25T15:20:43.616578+0000","last_fullsized":"2024-04-25T15:20:43.616578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:08.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616451+0000","last_change":"2024-04-25T15:20:42.416175+0000","last_active":"2024-04-25T15:20:43.616451+0000","last_peered":"2024-04-25T15:20:43.616451+0000","last_clean":"2024-04-25T15:20:43.616451+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:20:43.616451+0000","last_undegraded":"2024-04-25T15:20:43.616451+0000","last_fullsized":"2024-04-25T15:20:43.616451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:12.712238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406285+0000","last_change":"2024-04-25T15:20:42.419392+0000","last_active":"2024-04-25T15:20:43.406285+0000","last_peered":"2024-04-25T15:20:43.406285+0000","last_clean":"2024-04-25T15:20:43.406285+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:20:43.406285+0000","last_undegraded":"2024-04-25T15:20:43.406285+0000","last_fullsized":"2024-04-25T15:20:43.406285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:14.498820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616583+0000","last_change":"2024-04-25T15:20:42.421681+0000","last_active":"2024-04-25T15:20:43.616583+0000","last_peered":"2024-04-25T15:20:43.616583+0000","last_clean":"2024-04-25T15:20:43.616583+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:20:43.616583+0000","last_undegraded":"2024-04-25T15:20:43.616583+0000","last_fullsized":"2024-04-25T15:20:43.616583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616401+0000","last_change":"2024-04-25T15:20:42.418252+0000","last_active":"2024-04-25T15:20:43.616401+0000","last_peered":"2024-04-25T15:20:43.616401+0000","last_clean":"2024-04-25T15:20:43.616401+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:20:43.616401+0000","last_undegraded":"2024-04-25T15:20:43.616401+0000","last_fullsized":"2024-04-25T15:20:43.616401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616126+0000","last_change":"2024-04-25T15:20:42.428193+0000","last_active":"2024-04-25T15:20:43.616126+0000","last_peered":"2024-04-25T15:20:43.616126+0000","last_clean":"2024-04-25T15:20:43.616126+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:20:43.616126+0000","last_undegraded":"2024-04-25T15:20:43.616126+0000","last_fullsized":"2024-04-25T15:20:43.616126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:34.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616784+0000","last_change":"2024-04-25T15:20:42.422940+0000","last_active":"2024-04-25T15:20:43.616784+0000","last_peered":"2024-04-25T15:20:43.616784+0000","last_clean":"2024-04-25T15:20:43.616784+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:20:43.616784+0000","last_undegraded":"2024-04-25T15:20:43.616784+0000","last_fullsized":"2024-04-25T15:20:43.616784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615727+0000","last_change":"2024-04-25T15:20:42.424516+0000","last_active":"2024-04-25T15:20:43.615727+0000","last_peered":"2024-04-25T15:20:43.615727+0000","last_clean":"2024-04-25T15:20:43.615727+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:20:43.615727+0000","last_undegraded":"2024-04-25T15:20:43.615727+0000","last_fullsized":"2024-04-25T15:20:43.615727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616785+0000","last_change":"2024-04-25T15:20:42.427631+0000","last_active":"2024-04-25T15:20:43.616785+0000","last_peered":"2024-04-25T15:20:43.616785+0000","last_clean":"2024-04-25T15:20:43.616785+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:20:43.616785+0000","last_undegraded":"2024-04-25T15:20:43.616785+0000","last_fullsized":"2024-04-25T15:20:43.616785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.617047+0000","last_change":"2024-04-25T15:20:42.425058+0000","last_active":"2024-04-25T15:20:43.617047+0000","last_peered":"2024-04-25T15:20:43.617047+0000","last_clean":"2024-04-25T15:20:43.617047+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:20:43.617047+0000","last_undegraded":"2024-04-25T15:20:43.617047+0000","last_fullsized":"2024-04-25T15:20:43.617047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401101+0000","last_change":"2024-04-25T15:20:42.428962+0000","last_active":"2024-04-25T15:20:43.401101+0000","last_peered":"2024-04-25T15:20:43.401101+0000","last_clean":"2024-04-25T15:20:43.401101+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:20:43.401101+0000","last_undegraded":"2024-04-25T15:20:43.401101+0000","last_fullsized":"2024-04-25T15:20:43.401101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616796+0000","last_change":"2024-04-25T15:20:42.428532+0000","last_active":"2024-04-25T15:20:43.616796+0000","last_peered":"2024-04-25T15:20:43.616796+0000","last_clean":"2024-04-25T15:20:43.616796+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:20:43.616796+0000","last_undegraded":"2024-04-25T15:20:43.616796+0000","last_fullsized":"2024-04-25T15:20:43.616796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616591+0000","last_change":"2024-04-25T15:20:42.422835+0000","last_active":"2024-04-25T15:20:43.616591+0000","last_peered":"2024-04-25T15:20:43.616591+0000","last_clean":"2024-04-25T15:20:43.616591+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:20:43.616591+0000","last_undegraded":"2024-04-25T15:20:43.616591+0000","last_fullsized":"2024-04-25T15:20:43.616591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616308+0000","last_change":"2024-04-25T15:20:42.424071+0000","last_active":"2024-04-25T15:20:43.616308+0000","last_peered":"2024-04-25T15:20:43.616308+0000","last_clean":"2024-04-25T15:20:43.616308+0000","last_became_active":"2024-04-25T15:20:42.423222+0000","last_became_peered":"2024-04-25T15:20:42.423222+0000","last_unstale":"2024-04-25T15:20:43.616308+0000","last_undegraded":"2024-04-25T15:20:43.616308+0000","last_fullsized":"2024-04-25T15:20:43.616308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:35.713134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615633+0000","last_change":"2024-04-25T15:20:42.430516+0000","last_active":"2024-04-25T15:20:43.615633+0000","last_peered":"2024-04-25T15:20:43.615633+0000","last_clean":"2024-04-25T15:20:43.615633+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:20:43.615633+0000","last_undegraded":"2024-04-25T15:20:43.615633+0000","last_fullsized":"2024-04-25T15:20:43.615633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:03.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615705+0000","last_change":"2024-04-25T15:20:42.418805+0000","last_active":"2024-04-25T15:20:43.615705+0000","last_peered":"2024-04-25T15:20:43.615705+0000","last_clean":"2024-04-25T15:20:43.615705+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:20:43.615705+0000","last_undegraded":"2024-04-25T15:20:43.615705+0000","last_fullsized":"2024-04-25T15:20:43.615705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406202+0000","last_change":"2024-04-25T15:20:42.418203+0000","last_active":"2024-04-25T15:20:43.406202+0000","last_peered":"2024-04-25T15:20:43.406202+0000","last_clean":"2024-04-25T15:20:43.406202+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:20:43.406202+0000","last_undegraded":"2024-04-25T15:20:43.406202+0000","last_fullsized":"2024-04-25T15:20:43.406202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:12.712238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616620+0000","last_change":"2024-04-25T15:20:41.411834+0000","last_active":"2024-04-25T15:20:43.616620+0000","last_peered":"2024-04-25T15:20:43.616620+0000","last_clean":"2024-04-25T15:20:43.616620+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:20:43.616620+0000","last_undegraded":"2024-04-25T15:20:43.616620+0000","last_fullsized":"2024-04-25T15:20:43.616620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616907+0000","last_change":"2024-04-25T15:20:42.412522+0000","last_active":"2024-04-25T15:20:43.616907+0000","last_peered":"2024-04-25T15:20:43.616907+0000","last_clean":"2024-04-25T15:20:43.616907+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:20:43.616907+0000","last_undegraded":"2024-04-25T15:20:43.616907+0000","last_fullsized":"2024-04-25T15:20:43.616907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616024+0000","last_change":"2024-04-25T15:20:41.401581+0000","last_active":"2024-04-25T15:20:43.616024+0000","last_peered":"2024-04-25T15:20:43.616024+0000","last_clean":"2024-04-25T15:20:43.616024+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:20:43.616024+0000","last_undegraded":"2024-04-25T15:20:43.616024+0000","last_fullsized":"2024-04-25T15:20:43.616024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615982+0000","last_change":"2024-04-25T15:20:41.404692+0000","last_active":"2024-04-25T15:20:43.615982+0000","last_peered":"2024-04-25T15:20:43.615982+0000","last_clean":"2024-04-25T15:20:43.615982+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:20:43.615982+0000","last_undegraded":"2024-04-25T15:20:43.615982+0000","last_fullsized":"2024-04-25T15:20:43.615982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615787+0000","last_change":"2024-04-25T15:20:42.413772+0000","last_active":"2024-04-25T15:20:43.615787+0000","last_peered":"2024-04-25T15:20:43.615787+0000","last_clean":"2024-04-25T15:20:43.615787+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:20:43.615787+0000","last_undegraded":"2024-04-25T15:20:43.615787+0000","last_fullsized":"2024-04-25T15:20:43.615787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615953+0000","last_change":"2024-04-25T15:20:41.406208+0000","last_active":"2024-04-25T15:20:43.615953+0000","last_peered":"2024-04-25T15:20:43.615953+0000","last_clean":"2024-04-25T15:20:43.615953+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:20:43.615953+0000","last_undegraded":"2024-04-25T15:20:43.615953+0000","last_fullsized":"2024-04-25T15:20:43.615953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400977+0000","last_change":"2024-04-25T15:20:42.427938+0000","last_active":"2024-04-25T15:20:43.400977+0000","last_peered":"2024-04-25T15:20:43.400977+0000","last_clean":"2024-04-25T15:20:43.400977+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:20:43.400977+0000","last_undegraded":"2024-04-25T15:20:43.400977+0000","last_fullsized":"2024-04-25T15:20:43.400977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616877+0000","last_change":"2024-04-25T15:20:41.406067+0000","last_active":"2024-04-25T15:20:43.616877+0000","last_peered":"2024-04-25T15:20:43.616877+0000","last_clean":"2024-04-25T15:20:43.616877+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:20:43.616877+0000","last_undegraded":"2024-04-25T15:20:43.616877+0000","last_fullsized":"2024-04-25T15:20:43.616877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616134+0000","last_change":"2024-04-25T15:20:42.426143+0000","last_active":"2024-04-25T15:20:43.616134+0000","last_peered":"2024-04-25T15:20:43.616134+0000","last_clean":"2024-04-25T15:20:43.616134+0000","last_became_active":"2024-04-25T15:20:42.425823+0000","last_became_peered":"2024-04-25T15:20:42.425823+0000","last_unstale":"2024-04-25T15:20:43.616134+0000","last_undegraded":"2024-04-25T15:20:43.616134+0000","last_fullsized":"2024-04-25T15:20:43.616134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616252+0000","last_change":"2024-04-25T15:20:41.410325+0000","last_active":"2024-04-25T15:20:43.616252+0000","last_peered":"2024-04-25T15:20:43.616252+0000","last_clean":"2024-04-25T15:20:43.616252+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:20:43.616252+0000","last_undegraded":"2024-04-25T15:20:43.616252+0000","last_fullsized":"2024-04-25T15:20:43.616252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.617013+0000","last_change":"2024-04-25T15:20:42.423079+0000","last_active":"2024-04-25T15:20:43.617013+0000","last_peered":"2024-04-25T15:20:43.617013+0000","last_clean":"2024-04-25T15:20:43.617013+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:20:43.617013+0000","last_undegraded":"2024-04-25T15:20:43.617013+0000","last_fullsized":"2024-04-25T15:20:43.617013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401225+0000","last_change":"2024-04-25T15:20:41.415893+0000","last_active":"2024-04-25T15:20:43.401225+0000","last_peered":"2024-04-25T15:20:43.401225+0000","last_clean":"2024-04-25T15:20:43.401225+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:20:43.401225+0000","last_undegraded":"2024-04-25T15:20:43.401225+0000","last_fullsized":"2024-04-25T15:20:43.401225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406160+0000","last_change":"2024-04-25T15:20:42.415485+0000","last_active":"2024-04-25T15:20:43.406160+0000","last_peered":"2024-04-25T15:20:43.406160+0000","last_clean":"2024-04-25T15:20:43.406160+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:20:43.406160+0000","last_undegraded":"2024-04-25T15:20:43.406160+0000","last_fullsized":"2024-04-25T15:20:43.406160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:03.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616702+0000","last_change":"2024-04-25T15:20:41.406750+0000","last_active":"2024-04-25T15:20:43.616702+0000","last_peered":"2024-04-25T15:20:43.616702+0000","last_clean":"2024-04-25T15:20:43.616702+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:20:43.616702+0000","last_undegraded":"2024-04-25T15:20:43.616702+0000","last_fullsized":"2024-04-25T15:20:43.616702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404818+0000","last_change":"2024-04-25T15:20:42.423197+0000","last_active":"2024-04-25T15:20:43.404818+0000","last_peered":"2024-04-25T15:20:43.404818+0000","last_clean":"2024-04-25T15:20:43.404818+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:20:43.404818+0000","last_undegraded":"2024-04-25T15:20:43.404818+0000","last_fullsized":"2024-04-25T15:20:43.404818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616717+0000","last_change":"2024-04-25T15:20:41.401705+0000","last_active":"2024-04-25T15:20:43.616717+0000","last_peered":"2024-04-25T15:20:43.616717+0000","last_clean":"2024-04-25T15:20:43.616717+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:20:43.616717+0000","last_undegraded":"2024-04-25T15:20:43.616717+0000","last_fullsized":"2024-04-25T15:20:43.616717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616538+0000","last_change":"2024-04-25T15:20:42.416896+0000","last_active":"2024-04-25T15:20:43.616538+0000","last_peered":"2024-04-25T15:20:43.616538+0000","last_clean":"2024-04-25T15:20:43.616538+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:20:43.616538+0000","last_undegraded":"2024-04-25T15:20:43.616538+0000","last_fullsized":"2024-04-25T15:20:43.616538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616404+0000","last_change":"2024-04-25T15:20:41.409212+0000","last_active":"2024-04-25T15:20:43.616404+0000","last_peered":"2024-04-25T15:20:43.616404+0000","last_clean":"2024-04-25T15:20:43.616404+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:20:43.616404+0000","last_undegraded":"2024-04-25T15:20:43.616404+0000","last_fullsized":"2024-04-25T15:20:43.616404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406079+0000","last_change":"2024-04-25T15:20:42.412386+0000","last_active":"2024-04-25T15:20:43.406079+0000","last_peered":"2024-04-25T15:20:43.406079+0000","last_clean":"2024-04-25T15:20:43.406079+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:20:43.406079+0000","last_undegraded":"2024-04-25T15:20:43.406079+0000","last_fullsized":"2024-04-25T15:20:43.406079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:16.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615809+0000","last_change":"2024-04-25T15:20:41.402015+0000","last_active":"2024-04-25T15:20:43.615809+0000","last_peered":"2024-04-25T15:20:43.615809+0000","last_clean":"2024-04-25T15:20:43.615809+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:20:43.615809+0000","last_undegraded":"2024-04-25T15:20:43.615809+0000","last_fullsized":"2024-04-25T15:20:43.615809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615723+0000","last_change":"2024-04-25T15:20:42.418565+0000","last_active":"2024-04-25T15:20:43.615723+0000","last_peered":"2024-04-25T15:20:43.615723+0000","last_clean":"2024-04-25T15:20:43.615723+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:20:43.615723+0000","last_undegraded":"2024-04-25T15:20:43.615723+0000","last_fullsized":"2024-04-25T15:20:43.615723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615665+0000","last_change":"2024-04-25T15:20:41.408427+0000","last_active":"2024-04-25T15:20:43.615665+0000","last_peered":"2024-04-25T15:20:43.615665+0000","last_clean":"2024-04-25T15:20:43.615665+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:20:43.615665+0000","last_undegraded":"2024-04-25T15:20:43.615665+0000","last_fullsized":"2024-04-25T15:20:43.615665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405200+0000","last_change":"2024-04-25T15:20:42.415542+0000","last_active":"2024-04-25T15:20:43.405200+0000","last_peered":"2024-04-25T15:20:43.405200+0000","last_clean":"2024-04-25T15:20:43.405200+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:20:43.405200+0000","last_undegraded":"2024-04-25T15:20:43.405200+0000","last_fullsized":"2024-04-25T15:20:43.405200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:08.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405718+0000","last_change":"2024-04-25T15:20:41.405515+0000","last_active":"2024-04-25T15:20:43.405718+0000","last_peered":"2024-04-25T15:20:43.405718+0000","last_clean":"2024-04-25T15:20:43.405718+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:20:43.405718+0000","last_undegraded":"2024-04-25T15:20:43.405718+0000","last_fullsized":"2024-04-25T15:20:43.405718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406362+0000","last_change":"2024-04-25T15:20:42.412473+0000","last_active":"2024-04-25T15:20:43.406362+0000","last_peered":"2024-04-25T15:20:43.406362+0000","last_clean":"2024-04-25T15:20:43.406362+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:20:43.406362+0000","last_undegraded":"2024-04-25T15:20:43.406362+0000","last_fullsized":"2024-04-25T15:20:43.406362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:37.101862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616569+0000","last_change":"2024-04-25T15:20:41.406806+0000","last_active":"2024-04-25T15:20:43.616569+0000","last_peered":"2024-04-25T15:20:43.616569+0000","last_clean":"2024-04-25T15:20:43.616569+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:20:43.616569+0000","last_undegraded":"2024-04-25T15:20:43.616569+0000","last_fullsized":"2024-04-25T15:20:43.616569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405950+0000","last_change":"2024-04-25T15:20:42.414216+0000","last_active":"2024-04-25T15:20:43.405950+0000","last_peered":"2024-04-25T15:20:43.405950+0000","last_clean":"2024-04-25T15:20:43.405950+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:20:43.405950+0000","last_undegraded":"2024-04-25T15:20:43.405950+0000","last_fullsized":"2024-04-25T15:20:43.405950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:11.295712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401342+0000","last_change":"2024-04-25T15:20:41.410562+0000","last_active":"2024-04-25T15:20:43.401342+0000","last_peered":"2024-04-25T15:20:43.401342+0000","last_clean":"2024-04-25T15:20:43.401342+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:20:43.401342+0000","last_undegraded":"2024-04-25T15:20:43.401342+0000","last_fullsized":"2024-04-25T15:20:43.401342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616931+0000","last_change":"2024-04-25T15:20:42.424064+0000","last_active":"2024-04-25T15:20:43.616931+0000","last_peered":"2024-04-25T15:20:43.616931+0000","last_clean":"2024-04-25T15:20:43.616931+0000","last_became_active":"2024-04-25T15:20:42.422759+0000","last_became_peered":"2024-04-25T15:20:42.422759+0000","last_unstale":"2024-04-25T15:20:43.616931+0000","last_undegraded":"2024-04-25T15:20:43.616931+0000","last_fullsized":"2024-04-25T15:20:43.616931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:16.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615991+0000","last_change":"2024-04-25T15:20:41.404065+0000","last_active":"2024-04-25T15:20:43.615991+0000","last_peered":"2024-04-25T15:20:43.615991+0000","last_clean":"2024-04-25T15:20:43.615991+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:20:43.615991+0000","last_undegraded":"2024-04-25T15:20:43.615991+0000","last_fullsized":"2024-04-25T15:20:43.615991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405069+0000","last_change":"2024-04-25T15:20:42.422505+0000","last_active":"2024-04-25T15:20:43.405069+0000","last_peered":"2024-04-25T15:20:43.405069+0000","last_clean":"2024-04-25T15:20:43.405069+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:20:43.405069+0000","last_undegraded":"2024-04-25T15:20:43.405069+0000","last_fullsized":"2024-04-25T15:20:43.405069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:35.713134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404763+0000","last_change":"2024-04-25T15:20:30.873208+0000","last_active":"2024-04-25T15:20:43.404763+0000","last_peered":"2024-04-25T15:20:43.404763+0000","last_clean":"2024-04-25T15:20:43.404763+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:20:43.404763+0000","last_undegraded":"2024-04-25T15:20:43.404763+0000","last_fullsized":"2024-04-25T15:20:43.404763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_clean_scrub_stamp":"2024-04-25T15:20:29.835147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:59.356200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615795+0000","last_change":"2024-04-25T15:20:41.403922+0000","last_active":"2024-04-25T15:20:43.615795+0000","last_peered":"2024-04-25T15:20:43.615795+0000","last_clean":"2024-04-25T15:20:43.615795+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:20:43.615795+0000","last_undegraded":"2024-04-25T15:20:43.615795+0000","last_fullsized":"2024-04-25T15:20:43.615795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616811+0000","last_change":"2024-04-25T15:20:42.432737+0000","last_active":"2024-04-25T15:20:43.616811+0000","last_peered":"2024-04-25T15:20:43.616811+0000","last_clean":"2024-04-25T15:20:43.616811+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:20:43.616811+0000","last_undegraded":"2024-04-25T15:20:43.616811+0000","last_fullsized":"2024-04-25T15:20:43.616811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:34.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405238+0000","last_change":"2024-04-25T15:20:41.410568+0000","last_active":"2024-04-25T15:20:43.405238+0000","last_peered":"2024-04-25T15:20:43.405238+0000","last_clean":"2024-04-25T15:20:43.405238+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:20:43.405238+0000","last_undegraded":"2024-04-25T15:20:43.405238+0000","last_fullsized":"2024-04-25T15:20:43.405238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616090+0000","last_change":"2024-04-25T15:20:42.410449+0000","last_active":"2024-04-25T15:20:43.616090+0000","last_peered":"2024-04-25T15:20:43.616090+0000","last_clean":"2024-04-25T15:20:43.616090+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:20:43.616090+0000","last_undegraded":"2024-04-25T15:20:43.616090+0000","last_fullsized":"2024-04-25T15:20:43.616090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:01.422318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615696+0000","last_change":"2024-04-25T15:20:41.406046+0000","last_active":"2024-04-25T15:20:43.615696+0000","last_peered":"2024-04-25T15:20:43.615696+0000","last_clean":"2024-04-25T15:20:43.615696+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:20:43.615696+0000","last_undegraded":"2024-04-25T15:20:43.615696+0000","last_fullsized":"2024-04-25T15:20:43.615696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400998+0000","last_change":"2024-04-25T15:20:42.419446+0000","last_active":"2024-04-25T15:20:43.400998+0000","last_peered":"2024-04-25T15:20:43.400998+0000","last_clean":"2024-04-25T15:20:43.400998+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:20:43.400998+0000","last_undegraded":"2024-04-25T15:20:43.400998+0000","last_fullsized":"2024-04-25T15:20:43.400998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616445+0000","last_change":"2024-04-25T15:20:41.410676+0000","last_active":"2024-04-25T15:20:43.616445+0000","last_peered":"2024-04-25T15:20:43.616445+0000","last_clean":"2024-04-25T15:20:43.616445+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:20:43.616445+0000","last_undegraded":"2024-04-25T15:20:43.616445+0000","last_fullsized":"2024-04-25T15:20:43.616445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405821+0000","last_change":"2024-04-25T15:20:42.406333+0000","last_active":"2024-04-25T15:20:43.405821+0000","last_peered":"2024-04-25T15:20:43.405821+0000","last_clean":"2024-04-25T15:20:43.405821+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:20:43.405821+0000","last_undegraded":"2024-04-25T15:20:43.405821+0000","last_fullsized":"2024-04-25T15:20:43.405821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:33.466178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401234+0000","last_change":"2024-04-25T15:20:41.413703+0000","last_active":"2024-04-25T15:20:43.401234+0000","last_peered":"2024-04-25T15:20:43.401234+0000","last_clean":"2024-04-25T15:20:43.401234+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:20:43.401234+0000","last_undegraded":"2024-04-25T15:20:43.401234+0000","last_fullsized":"2024-04-25T15:20:43.401234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616898+0000","last_change":"2024-04-25T15:20:42.424028+0000","last_active":"2024-04-25T15:20:43.616898+0000","last_peered":"2024-04-25T15:20:43.616898+0000","last_clean":"2024-04-25T15:20:43.616898+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:20:43.616898+0000","last_undegraded":"2024-04-25T15:20:43.616898+0000","last_fullsized":"2024-04-25T15:20:43.616898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:26.290972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406206+0000","last_change":"2024-04-25T15:20:41.408759+0000","last_active":"2024-04-25T15:20:43.406206+0000","last_peered":"2024-04-25T15:20:43.406206+0000","last_clean":"2024-04-25T15:20:43.406206+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:20:43.406206+0000","last_undegraded":"2024-04-25T15:20:43.406206+0000","last_fullsized":"2024-04-25T15:20:43.406206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:41.992733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401262+0000","last_change":"2024-04-25T15:20:42.418890+0000","last_active":"2024-04-25T15:20:43.401262+0000","last_peered":"2024-04-25T15:20:43.401262+0000","last_clean":"2024-04-25T15:20:43.401262+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:20:43.401262+0000","last_undegraded":"2024-04-25T15:20:43.401262+0000","last_fullsized":"2024-04-25T15:20:43.401262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:44.420974+0000","last_change":"2024-04-25T15:20:41.409877+0000","last_active":"2024-04-25T15:20:44.420974+0000","last_peered":"2024-04-25T15:20:44.420974+0000","last_clean":"2024-04-25T15:20:44.420974+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:20:44.420974+0000","last_undegraded":"2024-04-25T15:20:44.420974+0000","last_fullsized":"2024-04-25T15:20:44.420974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616942+0000","last_change":"2024-04-25T15:20:42.428777+0000","last_active":"2024-04-25T15:20:43.616942+0000","last_peered":"2024-04-25T15:20:43.616942+0000","last_clean":"2024-04-25T15:20:43.616942+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:20:43.616942+0000","last_undegraded":"2024-04-25T15:20:43.616942+0000","last_fullsized":"2024-04-25T15:20:43.616942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616981+0000","last_change":"2024-04-25T15:20:41.410949+0000","last_active":"2024-04-25T15:20:43.616981+0000","last_peered":"2024-04-25T15:20:43.616981+0000","last_clean":"2024-04-25T15:20:43.616981+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:20:43.616981+0000","last_undegraded":"2024-04-25T15:20:43.616981+0000","last_fullsized":"2024-04-25T15:20:43.616981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616443+0000","last_change":"2024-04-25T15:20:42.413542+0000","last_active":"2024-04-25T15:20:43.616443+0000","last_peered":"2024-04-25T15:20:43.616443+0000","last_clean":"2024-04-25T15:20:43.616443+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:20:43.616443+0000","last_undegraded":"2024-04-25T15:20:43.616443+0000","last_fullsized":"2024-04-25T15:20:43.616443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404657+0000","last_change":"2024-04-25T15:20:41.405078+0000","last_active":"2024-04-25T15:20:43.404657+0000","last_peered":"2024-04-25T15:20:43.404657+0000","last_clean":"2024-04-25T15:20:43.404657+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:20:43.404657+0000","last_undegraded":"2024-04-25T15:20:43.404657+0000","last_fullsized":"2024-04-25T15:20:43.404657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406027+0000","last_change":"2024-04-25T15:20:42.413408+0000","last_active":"2024-04-25T15:20:43.406027+0000","last_peered":"2024-04-25T15:20:43.406027+0000","last_clean":"2024-04-25T15:20:43.406027+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:20:43.406027+0000","last_undegraded":"2024-04-25T15:20:43.406027+0000","last_fullsized":"2024-04-25T15:20:43.406027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:37.360885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401097+0000","last_change":"2024-04-25T15:20:41.411766+0000","last_active":"2024-04-25T15:20:43.401097+0000","last_peered":"2024-04-25T15:20:43.401097+0000","last_clean":"2024-04-25T15:20:43.401097+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:20:43.401097+0000","last_undegraded":"2024-04-25T15:20:43.401097+0000","last_fullsized":"2024-04-25T15:20:43.401097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616281+0000","last_change":"2024-04-25T15:20:42.417444+0000","last_active":"2024-04-25T15:20:43.616281+0000","last_peered":"2024-04-25T15:20:43.616281+0000","last_clean":"2024-04-25T15:20:43.616281+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:20:43.616281+0000","last_undegraded":"2024-04-25T15:20:43.616281+0000","last_fullsized":"2024-04-25T15:20:43.616281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401096+0000","last_change":"2024-04-25T15:20:41.406926+0000","last_active":"2024-04-25T15:20:43.401096+0000","last_peered":"2024-04-25T15:20:43.401096+0000","last_clean":"2024-04-25T15:20:43.401096+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:20:43.401096+0000","last_undegraded":"2024-04-25T15:20:43.401096+0000","last_fullsized":"2024-04-25T15:20:43.401096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616486+0000","last_change":"2024-04-25T15:20:42.422510+0000","last_active":"2024-04-25T15:20:43.616486+0000","last_peered":"2024-04-25T15:20:43.616486+0000","last_clean":"2024-04-25T15:20:43.616486+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:20:43.616486+0000","last_undegraded":"2024-04-25T15:20:43.616486+0000","last_fullsized":"2024-04-25T15:20:43.616486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406194+0000","last_change":"2024-04-25T15:20:41.408140+0000","last_active":"2024-04-25T15:20:43.406194+0000","last_peered":"2024-04-25T15:20:43.406194+0000","last_clean":"2024-04-25T15:20:43.406194+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:20:43.406194+0000","last_undegraded":"2024-04-25T15:20:43.406194+0000","last_fullsized":"2024-04-25T15:20:43.406194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615884+0000","last_change":"2024-04-25T15:20:42.421911+0000","last_active":"2024-04-25T15:20:43.615884+0000","last_peered":"2024-04-25T15:20:43.615884+0000","last_clean":"2024-04-25T15:20:43.615884+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:20:43.615884+0000","last_undegraded":"2024-04-25T15:20:43.615884+0000","last_fullsized":"2024-04-25T15:20:43.615884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616795+0000","last_change":"2024-04-25T15:20:42.421340+0000","last_active":"2024-04-25T15:20:43.616795+0000","last_peered":"2024-04-25T15:20:43.616795+0000","last_clean":"2024-04-25T15:20:43.616795+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:20:43.616795+0000","last_undegraded":"2024-04-25T15:20:43.616795+0000","last_fullsized":"2024-04-25T15:20:43.616795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:11.295712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405091+0000","last_change":"2024-04-25T15:20:41.408459+0000","last_active":"2024-04-25T15:20:43.405091+0000","last_peered":"2024-04-25T15:20:43.405091+0000","last_clean":"2024-04-25T15:20:43.405091+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:20:43.405091+0000","last_undegraded":"2024-04-25T15:20:43.405091+0000","last_fullsized":"2024-04-25T15:20:43.405091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616609+0000","last_change":"2024-04-25T15:20:42.421601+0000","last_active":"2024-04-25T15:20:43.616609+0000","last_peered":"2024-04-25T15:20:43.616609+0000","last_clean":"2024-04-25T15:20:43.616609+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:20:43.616609+0000","last_undegraded":"2024-04-25T15:20:43.616609+0000","last_fullsized":"2024-04-25T15:20:43.616609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:41.305637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405989+0000","last_change":"2024-04-25T15:20:41.408914+0000","last_active":"2024-04-25T15:20:43.405989+0000","last_peered":"2024-04-25T15:20:43.405989+0000","last_clean":"2024-04-25T15:20:43.405989+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:20:43.405989+0000","last_undegraded":"2024-04-25T15:20:43.405989+0000","last_fullsized":"2024-04-25T15:20:43.405989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.598854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616433+0000","last_change":"2024-04-25T15:20:42.423383+0000","last_active":"2024-04-25T15:20:43.616433+0000","last_peered":"2024-04-25T15:20:43.616433+0000","last_clean":"2024-04-25T15:20:43.616433+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:20:43.616433+0000","last_undegraded":"2024-04-25T15:20:43.616433+0000","last_fullsized":"2024-04-25T15:20:43.616433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616854+0000","last_change":"2024-04-25T15:20:41.405976+0000","last_active":"2024-04-25T15:20:43.616854+0000","last_peered":"2024-04-25T15:20:43.616854+0000","last_clean":"2024-04-25T15:20:43.616854+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:20:43.616854+0000","last_undegraded":"2024-04-25T15:20:43.616854+0000","last_fullsized":"2024-04-25T15:20:43.616854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616697+0000","last_change":"2024-04-25T15:20:42.429601+0000","last_active":"2024-04-25T15:20:43.616697+0000","last_peered":"2024-04-25T15:20:43.616697+0000","last_clean":"2024-04-25T15:20:43.616697+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:20:43.616697+0000","last_undegraded":"2024-04-25T15:20:43.616697+0000","last_fullsized":"2024-04-25T15:20:43.616697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616853+0000","last_change":"2024-04-25T15:20:41.410750+0000","last_active":"2024-04-25T15:20:43.616853+0000","last_peered":"2024-04-25T15:20:43.616853+0000","last_clean":"2024-04-25T15:20:43.616853+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:20:43.616853+0000","last_undegraded":"2024-04-25T15:20:43.616853+0000","last_fullsized":"2024-04-25T15:20:43.616853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:20:46.846 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T15:20:46.846 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T15:20:46.846 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T15:20:46.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T15:20:46.847 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T15:20:46.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.992+0000 7f7de9385640 1 Processor -- start 2024-04-25T15:20:46.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.992+0000 7f7de9385640 1 -- start start 2024-04-25T15:20:46.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de9385640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4149840 0x7f7de406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de9385640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7de40be0e0 0x7f7de40bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:46.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de9385640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de4149d40 con 0x7f7de40be4f0 2024-04-25T15:20:46.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de9385640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f7de414a820 con 0x7f7de40be0e0 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de9385640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7de414a020 con 0x7f7de4149840 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de27fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7de40be0e0 0x7f7de40bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de27fc640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7de40be0e0 0x7f7de40bc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50996/0 (socket says 172.21.15.33:50996) 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de27fc640 1 -- 172.21.15.33:0/766416357 learned_addr learned my addr 172.21.15.33:0/766416357 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.993+0000 7f7de2ffd640 1 --2- 172.21.15.33:0/766416357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4149840 0x7f7de406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.994+0000 7f7de27fc640 1 -- 172.21.15.33:0/766416357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4149840 msgr2=0x7f7de406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.994+0000 7f7de27fc640 1 --2- 172.21.15.33:0/766416357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4149840 0x7f7de406d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.994+0000 7f7de27fc640 1 -- 172.21.15.33:0/766416357 >> v1:172.21.15.155:6789/0 conn(0x7f7de40be4f0 legacy=0x7f7de409d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.994+0000 7f7de27fc640 1 -- 172.21.15.33:0/766416357 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de414a300 con 0x7f7de40be0e0 2024-04-25T15:20:46.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.994+0000 7f7de27fc640 1 --2- 172.21.15.33:0/766416357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de40be0e0 0x7f7de40bc9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009870 tx=0x7f7dd802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335abb8b463350cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:46.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.994+0000 7f7de1ffb640 1 -- 172.21.15.33:0/766416357 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8037070 con 0x7f7de40be0e0 2024-04-25T15:20:46.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.994+0000 7f7de1ffb640 1 -- 172.21.15.33:0/766416357 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd8032440 con 0x7f7de40be0e0 2024-04-25T15:20:46.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de1ffb640 1 -- 172.21.15.33:0/766416357 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8032810 con 0x7f7de40be0e0 2024-04-25T15:20:46.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de9385640 1 -- 172.21.15.33:0/766416357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de40be0e0 msgr2=0x7f7de40bc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:46.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de9385640 1 --2- 172.21.15.33:0/766416357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de40be0e0 0x7f7de40bc9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009870 tx=0x7f7dd802a210 comp rx=0 tx=0).stop 2024-04-25T15:20:46.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de9385640 1 -- 172.21.15.33:0/766416357 shutdown_connections 2024-04-25T15:20:46.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de9385640 1 --2- 172.21.15.33:0/766416357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de40be0e0 0x7f7de40bc9f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de9385640 1 --2- 172.21.15.33:0/766416357 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4149840 0x7f7de406d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:46.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de9385640 1 -- 172.21.15.33:0/766416357 >> 172.21.15.33:0/766416357 conn(0x7f7de40bebf0 msgr2=0x7f7de40bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:46.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de9385640 1 -- 172.21.15.33:0/766416357 shutdown_connections 2024-04-25T15:20:46.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.995+0000 7f7de9385640 1 -- 172.21.15.33:0/766416357 wait complete. 2024-04-25T15:20:46.998 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.997+0000 7f7de9385640 1 Processor -- start 2024-04-25T15:20:46.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.997+0000 7f7de9385640 1 -- start start 2024-04-25T15:20:47.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de9385640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de40be0e0 0x7f7de41df450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de9385640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40be4f0 0x7f7de40b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de9385640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de4149840 0x7f7de41463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de9385640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7de40bcf30 con 0x7f7de4149840 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de9385640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7de409dd40 con 0x7f7de40be0e0 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de9385640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7de40bd0b0 con 0x7f7de40be4f0 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de4149840 0x7f7de41463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de4149840 0x7f7de41463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51000/0 (socket says 172.21.15.33:51000) 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de37fe640 1 -- 172.21.15.33:0/1740482643 learned_addr learned my addr 172.21.15.33:0/1740482643 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de27fc640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40be4f0 0x7f7de40b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de2ffd640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de40be0e0 0x7f7de41df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de37fe640 1 -- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40be4f0 msgr2=0x7f7de40b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de37fe640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40be4f0 0x7f7de40b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de37fe640 1 -- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de40be0e0 msgr2=0x7f7de41df450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de37fe640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de40be0e0 0x7f7de41df450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.998+0000 7f7de37fe640 1 -- 172.21.15.33:0/1740482643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de41df990 con 0x7f7de4149840 2024-04-25T15:20:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.999+0000 7f7de37fe640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de4149840 0x7f7de41463b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00b9e0 tx=0x7f7ddc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.999+0000 7f7dcb7fe640 1 -- 172.21.15.33:0/1740482643 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc003b70 con 0x7f7de4149840 2024-04-25T15:20:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.999+0000 7f7dcb7fe640 1 -- 172.21.15.33:0/1740482643 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ddc003d10 con 0x7f7de4149840 2024-04-25T15:20:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.999+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de4147030 con 0x7f7de4149840 2024-04-25T15:20:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.999+0000 7f7dcb7fe640 1 -- 172.21.15.33:0/1740482643 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc00cb60 con 0x7f7de4149840 2024-04-25T15:20:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:46.999+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de41e2ca0 con 0x7f7de4149840 2024-04-25T15:20:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.000+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de41dfb60 con 0x7f7de4149840 2024-04-25T15:20:47.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.000+0000 7f7dcb7fe640 1 -- 172.21.15.33:0/1740482643 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7ddc00cd00 con 0x7f7de4149840 2024-04-25T15:20:47.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.001+0000 7f7dcb7fe640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7dd00744b0 0x7f7dd00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.001+0000 7f7dcb7fe640 1 -- 172.21.15.33:0/1740482643 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ddc094fc0 con 0x7f7de4149840 2024-04-25T15:20:47.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.001+0000 7f7de2ffd640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7dd00744b0 0x7f7dd00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.002+0000 7f7de2ffd640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7dd00744b0 0x7f7dd00769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40079a0 tx=0x7f7dd4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:47.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.006+0000 7f7dcb7fe640 1 -- 172.21.15.33:0/1740482643 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ddc05f110 con 0x7f7de4149840 2024-04-25T15:20:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.243+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7de40764e0 con 0x7f7de4149840 2024-04-25T15:20:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.246+0000 7f7dcb7fe640 1 -- 172.21.15.33:0/1740482643 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186745 (secure 0 0 0) 0x7f7ddc063410 con 0x7f7de4149840 2024-04-25T15:20:47.250 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7dd00744b0 msgr2=0x7f7dd00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7dd00744b0 0x7f7dd00769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40079a0 tx=0x7f7dd4008040 comp rx=0 tx=0).stop 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de4149840 msgr2=0x7f7de41463b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de4149840 0x7f7de41463b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00b9e0 tx=0x7f7ddc00bea0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 shutdown_connections 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7dd00744b0 0x7f7dd00769c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7de4149840 0x7f7de41463b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40be4f0 0x7f7de40b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 --2- 172.21.15.33:0/1740482643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de40be0e0 0x7f7de41df450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 >> 172.21.15.33:0/1740482643 conn(0x7f7de40bebf0 msgr2=0x7f7de40bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 shutdown_connections 2024-04-25T15:20:47.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.249+0000 7f7de9385640 1 -- 172.21.15.33:0/1740482643 wait complete. 2024-04-25T15:20:47.262 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":794053036},{"type":"v1","addr":"172.21.15.155:6833","nonce":794053036}]},"active_addr":"172.21.15.155:6833/794053036","active_change":"2024-04-25T15:20:21.693467+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":4020791213}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":864399315}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":2986228201}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":910703751}]}]} 2024-04-25T15:20:47.265 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T15:20:47.265 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T15:20:47.265 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:47.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.376+0000 7f70d5ae0640 1 Processor -- start 2024-04-25T15:20:47.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.376+0000 7f70d5ae0640 1 -- start start 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70d5ae0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d00b9570 0x7f70d006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70d5ae0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70d014cd40 0x7f70d009d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70d5ae0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d00b99b0 con 0x7f70d00ba490 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70d5ae0640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f70d00b9c90 con 0x7f70d014cd40 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70d5ae0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70d00b9f70 con 0x7f70d00b9570 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70cffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70d014cd40 0x7f70d009d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70cffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70d014cd40 0x7f70d009d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51002/0 (socket says 172.21.15.33:51002) 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70cffff640 1 -- 172.21.15.33:0/4091209080 learned_addr learned my addr 172.21.15.33:0/4091209080 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:47.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70cf7fe640 1 --2- 172.21.15.33:0/4091209080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d00b9570 0x7f70d006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70cffff640 1 -- 172.21.15.33:0/4091209080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d00b9570 msgr2=0x7f70d006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:47.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70cffff640 1 --2- 172.21.15.33:0/4091209080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d00b9570 0x7f70d006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70cffff640 1 -- 172.21.15.33:0/4091209080 >> v1:172.21.15.155:6789/0 conn(0x7f70d00ba490 legacy=0x7f70d00be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.377+0000 7f70cffff640 1 -- 172.21.15.33:0/4091209080 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d014d150 con 0x7f70d014cd40 2024-04-25T15:20:47.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.378+0000 7f70cffff640 1 --2- 172.21.15.33:0/4091209080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d014cd40 0x7f70d009d610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009e50 tx=0x7f70c802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a03dff0a0b77b6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:47.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.378+0000 7f70ce7fc640 1 -- 172.21.15.33:0/4091209080 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8036070 con 0x7f70d014cd40 2024-04-25T15:20:47.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.378+0000 7f70ce7fc640 1 -- 172.21.15.33:0/4091209080 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c8031600 con 0x7f70d014cd40 2024-04-25T15:20:47.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.378+0000 7f70ce7fc640 1 -- 172.21.15.33:0/4091209080 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80319d0 con 0x7f70d014cd40 2024-04-25T15:20:47.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.379+0000 7f70d5ae0640 1 -- 172.21.15.33:0/4091209080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d014cd40 msgr2=0x7f70d009d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.379+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/4091209080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d014cd40 0x7f70d009d610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009e50 tx=0x7f70c802a710 comp rx=0 tx=0).stop 2024-04-25T15:20:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.379+0000 7f70d5ae0640 1 -- 172.21.15.33:0/4091209080 shutdown_connections 2024-04-25T15:20:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.379+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/4091209080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d014cd40 0x7f70d009d610 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.379+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/4091209080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d00b9570 0x7f70d006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.379+0000 7f70d5ae0640 1 -- 172.21.15.33:0/4091209080 >> 172.21.15.33:0/4091209080 conn(0x7f70d00bebf0 msgr2=0x7f70d00bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.379+0000 7f70d5ae0640 1 -- 172.21.15.33:0/4091209080 shutdown_connections 2024-04-25T15:20:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.379+0000 7f70d5ae0640 1 -- 172.21.15.33:0/4091209080 wait complete. 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.380+0000 7f70d5ae0640 1 Processor -- start 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.381+0000 7f70d5ae0640 1 -- start start 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70d5ae0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d014cd40 0x7f70d0145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70d5ae0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70d0148970 0x7f70d013f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70d5ae0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d013fe90 0x7f70d01e2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70d5ae0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f70d01540b0 con 0x7f70d013fe90 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70d5ae0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70d009dde0 con 0x7f70d0148970 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70d5ae0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70d0154230 con 0x7f70d014cd40 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d013fe90 0x7f70d01e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d013fe90 0x7f70d01e2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51006/0 (socket says 172.21.15.33:51006) 2024-04-25T15:20:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 -- 172.21.15.33:0/1560287833 learned_addr learned my addr 172.21.15.33:0/1560287833 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cf7fe640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d014cd40 0x7f70d0145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70ceffd640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70d0148970 0x7f70d013f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 -- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d014cd40 msgr2=0x7f70d0145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d014cd40 0x7f70d0145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 -- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70d0148970 msgr2=0x7f70d013f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70d0148970 0x7f70d013f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 -- 172.21.15.33:0/1560287833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d00a2330 con 0x7f70d013fe90 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cf7fe640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d014cd40 0x7f70d0145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70cffff640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d013fe90 0x7f70d01e2910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009e50 tx=0x7f70c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.382+0000 7f70c7fff640 1 -- 172.21.15.33:0/1560287833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8036050 con 0x7f70d013fe90 2024-04-25T15:20:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.383+0000 7f70c7fff640 1 -- 172.21.15.33:0/1560287833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c8042070 con 0x7f70d013fe90 2024-04-25T15:20:47.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.383+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d014a930 con 0x7f70d013fe90 2024-04-25T15:20:47.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.383+0000 7f70c7fff640 1 -- 172.21.15.33:0/1560287833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8009510 con 0x7f70d013fe90 2024-04-25T15:20:47.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.383+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d0148110 con 0x7f70d013fe90 2024-04-25T15:20:47.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.384+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d00764e0 con 0x7f70d013fe90 2024-04-25T15:20:47.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.384+0000 7f70c7fff640 1 -- 172.21.15.33:0/1560287833 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f70c8007bf0 con 0x7f70d013fe90 2024-04-25T15:20:47.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.385+0000 7f70c7fff640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70b00744b0 0x7f70b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.385+0000 7f70c7fff640 1 -- 172.21.15.33:0/1560287833 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f70c80b5fa0 con 0x7f70d013fe90 2024-04-25T15:20:47.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.385+0000 7f70cf7fe640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70b00744b0 0x7f70b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.385+0000 7f70cf7fe640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70b00744b0 0x7f70b00769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70d014a900 tx=0x7f70c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:47.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.389+0000 7f70c7fff640 1 -- 172.21.15.33:0/1560287833 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f70c8080720 con 0x7f70d013fe90 2024-04-25T15:20:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.575+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70d009d510 con 0x7f70d013fe90 2024-04-25T15:20:47.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.576+0000 7f70c7fff640 1 -- 172.21.15.33:0/1560287833 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f70c8080020 con 0x7f70d013fe90 2024-04-25T15:20:47.577 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:47.578 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:43.397488+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:47.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70b00744b0 msgr2=0x7f70b00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70b00744b0 0x7f70b00769c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70d014a900 tx=0x7f70c0008040 comp rx=0 tx=0).stop 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d013fe90 msgr2=0x7f70d01e2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d013fe90 0x7f70d01e2910 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009e50 tx=0x7f70c8004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 shutdown_connections 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f70b00744b0 0x7f70b00769c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d013fe90 0x7f70d01e2910 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70d0148970 0x7f70d013f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 --2- 172.21.15.33:0/1560287833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70d014cd40 0x7f70d0145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 >> 172.21.15.33:0/1560287833 conn(0x7f70d00bebf0 msgr2=0x7f70d00bbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 shutdown_connections 2024-04-25T15:20:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.578+0000 7f70d5ae0640 1 -- 172.21.15.33:0/1560287833 wait complete. 2024-04-25T15:20:47.591 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T15:20:47.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.700+0000 7f27b7d2e640 1 Processor -- start 2024-04-25T15:20:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.700+0000 7f27b7d2e640 1 -- start start 2024-04-25T15:20:47.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.701+0000 7f27b7d2e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f27b00b9570 0x7f27b006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.701+0000 7f27b7d2e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f27b014cd40 0x7f27b009d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.701+0000 7f27b7d2e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b00b99b0 con 0x7f27b00ba490 2024-04-25T15:20:47.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.701+0000 7f27b7d2e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f27b00b9c90 con 0x7f27b014cd40 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.701+0000 7f27b7d2e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f27b00b9f70 con 0x7f27b00b9570 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.701+0000 7f27b62cb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f27b014cd40 0x7f27b009d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b52c9640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f27b00ba490 0x7f27b00be070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45164/0 (socket says 172.21.15.33:45164) 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b62cb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f27b014cd40 0x7f27b009d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51018/0 (socket says 172.21.15.33:51018) 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b52c9640 1 -- 172.21.15.33:0/1905512058 learned_addr learned my addr 172.21.15.33:0/1905512058 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b5aca640 1 --2- 172.21.15.33:0/1905512058 >> v2:172.21.15.155:3300/0 conn(0x7f27b00b9570 0x7f27b006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b62cb640 1 -- 172.21.15.33:0/1905512058 >> v2:172.21.15.155:3300/0 conn(0x7f27b00b9570 msgr2=0x7f27b006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b62cb640 1 --2- 172.21.15.33:0/1905512058 >> v2:172.21.15.155:3300/0 conn(0x7f27b00b9570 0x7f27b006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b62cb640 1 -- 172.21.15.33:0/1905512058 >> v1:172.21.15.33:6789/0 conn(0x7f27b00ba490 legacy=0x7f27b00be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b62cb640 1 -- 172.21.15.33:0/1905512058 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b014d150 con 0x7f27b014cd40 2024-04-25T15:20:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b5aca640 1 --2- 172.21.15.33:0/1905512058 >> v2:172.21.15.155:3300/0 conn(0x7f27b00b9570 0x7f27b006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.702+0000 7f27b4ac8640 1 -- 172.21.15.33:0/1905512058 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444297409 0 0) 0x7f27b00b99b0 con 0x7f27b00ba490 2024-04-25T15:20:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b62cb640 1 --2- 172.21.15.33:0/1905512058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b009d610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f27b006f1c0 tx=0x7f27ac02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5751e3bc256ed33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b4ac8640 1 -- 172.21.15.33:0/1905512058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac007740 con 0x7f27b014cd40 2024-04-25T15:20:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b4ac8640 1 -- 172.21.15.33:0/1905512058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ac0078e0 con 0x7f27b014cd40 2024-04-25T15:20:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b4ac8640 1 -- 172.21.15.33:0/1905512058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac007cb0 con 0x7f27b014cd40 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1905512058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 msgr2=0x7f27b009d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1905512058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b009d610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f27b006f1c0 tx=0x7f27ac02a680 comp rx=0 tx=0).stop 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1905512058 shutdown_connections 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1905512058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b009d610 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1905512058 >> v2:172.21.15.155:3300/0 conn(0x7f27b00b9570 0x7f27b006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.703+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1905512058 >> 172.21.15.33:0/1905512058 conn(0x7f27b00bebf0 msgr2=0x7f27b00bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.704+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1905512058 shutdown_connections 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.704+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1905512058 wait complete. 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.705+0000 7f27b7d2e640 1 Processor -- start 2024-04-25T15:20:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.705+0000 7f27b7d2e640 1 -- start start 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b7d2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b01468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b7d2e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b00b5ef0 0x7f27b01e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b7d2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b00b7d00 0x7f27b01e2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b7d2e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f27b01540b0 con 0x7f27b014cd40 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b7d2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27b009dd60 con 0x7f27b00b7d00 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b7d2e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27b0154230 con 0x7f27b00b5ef0 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b5aca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b01468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b5aca640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b01468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51032/0 (socket says 172.21.15.33:51032) 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b5aca640 1 -- 172.21.15.33:0/1717200398 learned_addr learned my addr 172.21.15.33:0/1717200398 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:47.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b62cb640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b00b7d00 0x7f27b01e2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b52c9640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b00b5ef0 0x7f27b01e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b5aca640 1 -- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b00b5ef0 msgr2=0x7f27b01e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b5aca640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b00b5ef0 0x7f27b01e2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b5aca640 1 -- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b00b7d00 msgr2=0x7f27b01e2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b5aca640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b00b7d00 0x7f27b01e2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.706+0000 7f27b5aca640 1 -- 172.21.15.33:0/1717200398 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b01476e0 con 0x7f27b014cd40 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.707+0000 7f27b5aca640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b01468c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27a800d800 tx=0x7f27a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.707+0000 7f27a67fc640 1 -- 172.21.15.33:0/1717200398 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80096a0 con 0x7f27b014cd40 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.707+0000 7f27a67fc640 1 -- 172.21.15.33:0/1717200398 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a8019070 con 0x7f27b014cd40 2024-04-25T15:20:47.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.707+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b01479c0 con 0x7f27b014cd40 2024-04-25T15:20:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.707+0000 7f27a67fc640 1 -- 172.21.15.33:0/1717200398 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8009a80 con 0x7f27b014cd40 2024-04-25T15:20:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.707+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b00b9530 con 0x7f27b014cd40 2024-04-25T15:20:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.708+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b00764e0 con 0x7f27b014cd40 2024-04-25T15:20:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.708+0000 7f27a67fc640 1 -- 172.21.15.33:0/1717200398 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f27a8009c20 con 0x7f27b014cd40 2024-04-25T15:20:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.709+0000 7f27a67fc640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f27940744b0 0x7f27940769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.709+0000 7f27b52c9640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f27940744b0 0x7f27940769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.709+0000 7f27a67fc640 1 -- 172.21.15.33:0/1717200398 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f27a8095700 con 0x7f27b014cd40 2024-04-25T15:20:47.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.710+0000 7f27b52c9640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f27940744b0 0x7f27940769c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f27b009d690 tx=0x7f27a0007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:47.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.714+0000 7f27a67fc640 1 -- 172.21.15.33:0/1717200398 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f27a805fdf0 con 0x7f27b014cd40 2024-04-25T15:20:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.901+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27b00be2c0 con 0x7f27b014cd40 2024-04-25T15:20:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.902+0000 7f27a67fc640 1 -- 172.21.15.33:0/1717200398 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f27a8066e20 con 0x7f27b014cd40 2024-04-25T15:20:47.904 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:47.905 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:43.397488+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f27940744b0 msgr2=0x7f27940769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f27940744b0 0x7f27940769c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f27b009d690 tx=0x7f27a0007c00 comp rx=0 tx=0).stop 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 msgr2=0x7f27b01468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b01468c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27a800d800 tx=0x7f27a800dcc0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 shutdown_connections 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f27940744b0 0x7f27940769c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b00b7d00 0x7f27b01e2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b00b5ef0 0x7f27b01e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 --2- 172.21.15.33:0/1717200398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27b014cd40 0x7f27b01468c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 >> 172.21.15.33:0/1717200398 conn(0x7f27b00bebf0 msgr2=0x7f27b00bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 shutdown_connections 2024-04-25T15:20:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:47.904+0000 7f27b7d2e640 1 -- 172.21.15.33:0/1717200398 wait complete. 2024-04-25T15:20:47.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T15:20:47.918 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T15:20:47.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T15:20:47.920 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T15:20:47.920 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T15:20:47.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T15:20:47.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T15:20:47.922 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T15:20:48.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.139+0000 7f612ede0640 1 Processor -- start 2024-04-25T15:20:48.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.139+0000 7f612ede0640 1 -- start start 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612ede0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806df60 0x7f612809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612ede0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f612806e370 0x7f61280b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612ede0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61280b5580 0x7f61280b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612ede0640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f61280b5ed0 con 0x7f61280b5580 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612ede0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f61280b6260 con 0x7f612806e370 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612ede0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61280b6820 con 0x7f612806df60 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612e5df640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61280b5580 0x7f61280b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612e5df640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61280b5580 0x7f61280b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51042/0 (socket says 172.21.15.33:51042) 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612e5df640 1 -- 172.21.15.33:0/3132304952 learned_addr learned my addr 172.21.15.33:0/3132304952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612d5dd640 1 --2- 172.21.15.33:0/3132304952 >> v2:172.21.15.155:3300/0 conn(0x7f612806e370 0x7f61280b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.141+0000 7f612ddde640 1 --2- 172.21.15.33:0/3132304952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806df60 0x7f612809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.142+0000 7f612e5df640 1 -- 172.21.15.33:0/3132304952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806df60 msgr2=0x7f612809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.142+0000 7f612e5df640 1 --2- 172.21.15.33:0/3132304952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806df60 0x7f612809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.142+0000 7f612e5df640 1 -- 172.21.15.33:0/3132304952 >> v2:172.21.15.155:3300/0 conn(0x7f612806e370 msgr2=0x7f61280b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.142+0000 7f612e5df640 1 --2- 172.21.15.33:0/3132304952 >> v2:172.21.15.155:3300/0 conn(0x7f612806e370 0x7f61280b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.142+0000 7f612e5df640 1 -- 172.21.15.33:0/3132304952 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61280b6cb0 con 0x7f61280b5580 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.142+0000 7f612e5df640 1 --2- 172.21.15.33:0/3132304952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61280b5580 0x7f61280b5990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f612806fe80 tx=0x7f612402e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8ae76b9496fe67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.143+0000 7f612cddc640 1 -- 172.21.15.33:0/3132304952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612403c070 con 0x7f61280b5580 2024-04-25T15:20:48.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.143+0000 7f612cddc640 1 -- 172.21.15.33:0/3132304952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6124034480 con 0x7f61280b5580 2024-04-25T15:20:48.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.143+0000 7f1c8afb1640 1 Processor -- start 2024-04-25T15:20:48.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.143+0000 7f1c8afb1640 1 -- start start 2024-04-25T15:20:48.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.143+0000 7fd76ca30640 1 Processor -- start 2024-04-25T15:20:48.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.144+0000 7feb44856640 1 Processor -- start 2024-04-25T15:20:48.148 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.144+0000 7feb44856640 1 -- start start 2024-04-25T15:20:48.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.144+0000 7f612cddc640 1 -- 172.21.15.33:0/3132304952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124034850 con 0x7f61280b5580 2024-04-25T15:20:48.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.144+0000 7f171759e640 1 Processor -- start 2024-04-25T15:20:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.144+0000 7f612ede0640 1 -- 172.21.15.33:0/3132304952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61280b5580 msgr2=0x7f61280b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.150 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.144+0000 7f612ede0640 1 --2- 172.21.15.33:0/3132304952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61280b5580 0x7f61280b5990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f612806fe80 tx=0x7f612402e750 comp rx=0 tx=0).stop 2024-04-25T15:20:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f612ede0640 1 -- 172.21.15.33:0/3132304952 shutdown_connections 2024-04-25T15:20:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f612ede0640 1 --2- 172.21.15.33:0/3132304952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61280b5580 0x7f61280b5990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f612ede0640 1 --2- 172.21.15.33:0/3132304952 >> v2:172.21.15.155:3300/0 conn(0x7f612806e370 0x7f61280b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f612ede0640 1 --2- 172.21.15.33:0/3132304952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806df60 0x7f612809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f612ede0640 1 -- 172.21.15.33:0/3132304952 >> 172.21.15.33:0/3132304952 conn(0x7f61280ba640 msgr2=0x7f61280baa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.144+0000 7f171759e640 1 -- start start 2024-04-25T15:20:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.144+0000 7fd76ca30640 1 -- start start 2024-04-25T15:20:48.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f612ede0640 1 -- 172.21.15.33:0/3132304952 shutdown_connections 2024-04-25T15:20:48.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f612ede0640 1 -- 172.21.15.33:0/3132304952 wait complete. 2024-04-25T15:20:48.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f1c8afb1640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c84145860 0x7f1c84145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7f1c8afb1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1c840b0890 0x7f1c840b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.145+0000 7feb44856640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb38029ca0 0x7feb38034870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb44856640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7feb380c9ce0 0x7feb380ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f1c8afb1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c840afb80 con 0x7f1c840af660 2024-04-25T15:20:48.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f1c8afb1640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f1c840afe60 con 0x7f1c84145860 2024-04-25T15:20:48.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f1c8afb1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1c841461b0 con 0x7f1c840b0890 2024-04-25T15:20:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7fd76ca30640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 0x7fd760039440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7fd76ca30640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd7600382c0 0x7fd7600dbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7fd76ca30640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd760036680 con 0x7fd760039980 2024-04-25T15:20:48.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb44856640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb38037c20 con 0x7feb38039a80 2024-04-25T15:20:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f95a8df3640 1 Processor -- start 2024-04-25T15:20:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f95a8df3640 1 -- start start 2024-04-25T15:20:48.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7fd76ca30640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fd76000e2f0 con 0x7fd7600382c0 2024-04-25T15:20:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7fd76ca30640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd76000e540 con 0x7fd76003dbb0 2024-04-25T15:20:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb3f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb38029ca0 0x7feb38034870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb3f7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb38029ca0 0x7feb38034870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45404/0 (socket says 172.21.15.33:45404) 2024-04-25T15:20:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb3f7fe640 1 -- 172.21.15.33:0/617570541 learned_addr learned my addr 172.21.15.33:0/617570541 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb3ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7feb380c9ce0 0x7feb380ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb3effd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7feb38039a80 0x7feb38037510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45172/0 (socket says 172.21.15.33:45172) 2024-04-25T15:20:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7fd767fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd7600382c0 0x7fd7600dbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7fd767fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd7600382c0 0x7fd7600dbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51062/0 (socket says 172.21.15.33:51062) 2024-04-25T15:20:48.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb44856640 1 -- 172.21.15.33:0/617570541 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7feb380c3ed0 con 0x7feb380c9ce0 2024-04-25T15:20:48.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f171759e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f17100323c0 0x7f17100cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f171759e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f17100396b0 0x7f171003a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f171759e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171001f7b0 con 0x7f171003abf0 2024-04-25T15:20:48.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f171759e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f171003a220 con 0x7f17100323c0 2024-04-25T15:20:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f171759e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1710039bd0 con 0x7f17100396b0 2024-04-25T15:20:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f01f5ccd640 1 Processor -- start 2024-04-25T15:20:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7feb44856640 1 -- 172.21.15.33:0/617570541 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb3802a1c0 con 0x7feb38029ca0 2024-04-25T15:20:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7fd767fff640 1 -- 172.21.15.33:0/369532292 learned_addr learned my addr 172.21.15.33:0/369532292 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.146+0000 7f1c897ae640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c84145860 0x7f1c84145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c897ae640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c84145860 0x7f1c84145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51048/0 (socket says 172.21.15.33:51048) 2024-04-25T15:20:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c897ae640 1 -- 172.21.15.33:0/1886276014 learned_addr learned my addr 172.21.15.33:0/1886276014 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1716d9d640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f171003abf0 0x7f17100c3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:49076/0 (socket says 172.21.15.33:49076) 2024-04-25T15:20:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1716d9d640 1 -- 172.21.15.33:0/4046818231 learned_addr learned my addr 172.21.15.33:0/4046818231 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7feb3e7fc640 1 -- 172.21.15.33:0/617570541 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618001962 0 0) 0x7feb38037c20 con 0x7feb38039a80 2024-04-25T15:20:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c8a7b0640 1 --2- 172.21.15.33:0/1886276014 >> v2:172.21.15.155:3300/0 conn(0x7f1c840b0890 0x7f1c840b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7feb3e7fc640 1 -- 172.21.15.33:0/617570541 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb30003520 con 0x7feb38039a80 2024-04-25T15:20:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f01f5ccd640 1 -- start start 2024-04-25T15:20:48.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1715d9b640 1 --2- 172.21.15.33:0/4046818231 >> v2:172.21.15.155:3300/0 conn(0x7f17100396b0 0x7f171003a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f171559a640 1 -- 172.21.15.33:0/4046818231 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440438566 0 0) 0x7f1708001110 con 0x7f171003abf0 2024-04-25T15:20:48.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f171559a640 1 -- 172.21.15.33:0/4046818231 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1700005730 con 0x7f171003abf0 2024-04-25T15:20:48.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c88fad640 1 -- 172.21.15.33:0/1886276014 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860741468 0 0) 0x7f1c840afb80 con 0x7f1c840af660 2024-04-25T15:20:48.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c88fad640 1 -- 172.21.15.33:0/1886276014 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c70003520 con 0x7f1c840af660 2024-04-25T15:20:48.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f612ede0640 1 Processor -- start 2024-04-25T15:20:48.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f612ede0640 1 -- start start 2024-04-25T15:20:48.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c8a7b0640 1 -- 172.21.15.33:0/1886276014 >> v2:172.21.15.33:3300/0 conn(0x7f1c84145860 msgr2=0x7f1c84145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c8a7b0640 1 --2- 172.21.15.33:0/1886276014 >> v2:172.21.15.33:3300/0 conn(0x7f1c84145860 0x7f1c84145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c8a7b0640 1 -- 172.21.15.33:0/1886276014 >> v1:172.21.15.155:6789/0 conn(0x7f1c840af660 legacy=0x7f1c8409f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7f1c8a7b0640 1 -- 172.21.15.33:0/1886276014 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c840b6da0 con 0x7f1c840b0890 2024-04-25T15:20:48.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f95a8df3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a4069860 0x7f95a40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7fd7677fe640 1 --2- 172.21.15.33:0/369532292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 0x7fd760039440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7fd767fff640 1 -- 172.21.15.33:0/369532292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 msgr2=0x7fd760039440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7fd767fff640 1 --2- 172.21.15.33:0/369532292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 0x7fd760039440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.147+0000 7fd767fff640 1 -- 172.21.15.33:0/369532292 >> v1:172.21.15.33:6789/0 conn(0x7fd760039980 legacy=0x7fd760037bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:20:48.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7fd767fff640 1 -- 172.21.15.33:0/369532292 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76003bb60 con 0x7fd7600382c0 2024-04-25T15:20:48.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f95a8df3640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f95a406f500 0x7f95a4150050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f95a259c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a4069860 0x7f95a40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f95a259c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a4069860 0x7f95a40b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45418/0 (socket says 172.21.15.33:45418) 2024-04-25T15:20:48.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f95a259c640 1 -- 172.21.15.33:0/304031433 learned_addr learned my addr 172.21.15.33:0/304031433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f95a8df3640 1 -- 172.21.15.33:0/304031433 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a4148f30 con 0x7f95a406f0f0 2024-04-25T15:20:48.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f171659c640 1 --2- 172.21.15.33:0/4046818231 >> v2:172.21.15.33:3300/0 conn(0x7f17100323c0 0x7f17100cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f618db4d640 1 Processor -- start 2024-04-25T15:20:48.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f01f5ccd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f013f790 0x7f01f0145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f1715d9b640 1 -- 172.21.15.33:0/4046818231 >> v2:172.21.15.33:3300/0 conn(0x7f17100323c0 msgr2=0x7f17100cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f1715d9b640 1 --2- 172.21.15.33:0/4046818231 >> v2:172.21.15.33:3300/0 conn(0x7f17100323c0 0x7f17100cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f1715d9b640 1 -- 172.21.15.33:0/4046818231 >> v1:172.21.15.155:6789/0 conn(0x7f171003abf0 legacy=0x7f17100c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7f1715d9b640 1 -- 172.21.15.33:0/4046818231 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1710039eb0 con 0x7f17100396b0 2024-04-25T15:20:48.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.148+0000 7feb3e7fc640 1 -- 172.21.15.33:0/617570541 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3643711156 0 0) 0x7feb30003520 con 0x7feb38039a80 2024-04-25T15:20:48.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a8df3640 1 -- 172.21.15.33:0/304031433 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f95a4149210 con 0x7f95a406f500 2024-04-25T15:20:48.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a8df3640 1 -- 172.21.15.33:0/304031433 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95a41494f0 con 0x7f95a4069860 2024-04-25T15:20:48.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f01ef7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f01f006d000 0x7f01f0072d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:49096/0 (socket says 172.21.15.33:49096) 2024-04-25T15:20:48.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a2d9d640 1 --2- 172.21.15.33:0/304031433 >> v2:172.21.15.33:3300/0 conn(0x7f95a406f500 0x7f95a4150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f1c8a7b0640 1 --2- 172.21.15.33:0/1886276014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 0x7f1c840b0ca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c84145640 tx=0x7f1c7c02ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=981792f8070a1a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7feb3ffff640 1 -- 172.21.15.33:0/617570541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb38029ca0 msgr2=0x7feb38034870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7feb3ffff640 1 --2- 172.21.15.33:0/617570541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb38029ca0 0x7feb38034870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7feb3ffff640 1 -- 172.21.15.33:0/617570541 >> v1:172.21.15.33:6789/0 conn(0x7feb38039a80 legacy=0x7feb38037510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7feb3ffff640 1 -- 172.21.15.33:0/617570541 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3802a4a0 con 0x7feb380c9ce0 2024-04-25T15:20:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f01ef7fe640 1 -- 172.21.15.33:0/1408095632 learned_addr learned my addr 172.21.15.33:0/1408095632 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675089448 0 0) 0x7f95a4148f30 con 0x7f95a406f0f0 2024-04-25T15:20:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f958c003520 con 0x7f95a406f0f0 2024-04-25T15:20:48.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f01eeffd640 1 --2- 172.21.15.33:0/1408095632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f013f790 0x7f01f0145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f1715d9b640 1 --2- 172.21.15.33:0/4046818231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17100396b0 0x7f171003a6b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f171003cbe0 tx=0x7f170c02e600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a7cc51fa0f0c87c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f01f5ccd640 1 -- 172.21.15.33:0/1408095632 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f0146690 con 0x7f01f013fba0 2024-04-25T15:20:48.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f01f5ccd640 1 -- 172.21.15.33:0/1408095632 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f00715b0 con 0x7f01f006d000 2024-04-25T15:20:48.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f01f5ccd640 1 -- 172.21.15.33:0/1408095632 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01f0071890 con 0x7f01f013f790 2024-04-25T15:20:48.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7fd767fff640 1 --2- 172.21.15.33:0/369532292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600382c0 0x7fd7600dbb70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009870 tx=0x7fd75c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83912ab5510a6c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f171559a640 1 -- 172.21.15.33:0/4046818231 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c03a070 con 0x7f17100396b0 2024-04-25T15:20:48.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f171559a640 1 -- 172.21.15.33:0/4046818231 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c033510 con 0x7f17100396b0 2024-04-25T15:20:48.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f1c88fad640 1 -- 172.21.15.33:0/1886276014 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c036070 con 0x7f1c840b0890 2024-04-25T15:20:48.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f1c88fad640 1 -- 172.21.15.33:0/1886276014 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7c032840 con 0x7f1c840b0890 2024-04-25T15:20:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f1c88fad640 1 -- 172.21.15.33:0/1886276014 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c032c30 con 0x7f1c840b0890 2024-04-25T15:20:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2805851990 0 0) 0x7f958c003520 con 0x7f95a406f0f0 2024-04-25T15:20:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a4069860 msgr2=0x7f95a40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a4069860 0x7f95a40b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 >> v2:172.21.15.33:3300/0 conn(0x7f95a406f500 msgr2=0x7f95a4150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 --2- 172.21.15.33:0/304031433 >> v2:172.21.15.33:3300/0 conn(0x7f95a406f500 0x7f95a4150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a40b6ce0 con 0x7f95a406f0f0 2024-04-25T15:20:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7f9594001670 con 0x7f95a406f0f0 2024-04-25T15:20:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 >> v1:172.21.15.155:6789/0 conn(0x7f95a406f0f0 legacy=0x7f95a40b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f95a159a640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f958c0039b0 0x7f958c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f95a159a640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f958c004800 0x7f958c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f95a159a640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f958c005150 0x7f958c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95a4149210 con 0x7f958c005150 2024-04-25T15:20:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95a41494f0 con 0x7f958c004800 2024-04-25T15:20:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f958c014920 con 0x7f958c0039b0 2024-04-25T15:20:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612ede0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f612806df60 0x7f6128153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f171559a640 1 -- 172.21.15.33:0/4046818231 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c033940 con 0x7f17100396b0 2024-04-25T15:20:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612ede0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806e370 0x7f61281f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612ede0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61280b5580 0x7f6128096910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7feb3ffff640 1 --2- 172.21.15.33:0/617570541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380c9ce0 0x7feb380ca0f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb40066010 tx=0x7feb400a7130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7bd85c9b8480c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7feb3e7fc640 1 -- 172.21.15.33:0/617570541 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb400b4070 con 0x7feb380c9ce0 2024-04-25T15:20:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7feb3e7fc640 1 -- 172.21.15.33:0/617570541 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb400a7a70 con 0x7feb380c9ce0 2024-04-25T15:20:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7feb3e7fc640 1 -- 172.21.15.33:0/617570541 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c001670 con 0x7feb380c9ce0 2024-04-25T15:20:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f01eeffd640 1 -- 172.21.15.33:0/1408095632 >> v1:172.21.15.155:6789/0 conn(0x7f01f006d000 legacy=0x7f01f0072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f01eeffd640 1 -- 172.21.15.33:0/1408095632 >> v1:172.21.15.33:6789/0 conn(0x7f01f013fba0 legacy=0x7f01f0071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612ede0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f61280afa60 con 0x7f612806df60 2024-04-25T15:20:48.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f01eeffd640 1 -- 172.21.15.33:0/1408095632 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f00b1a00 con 0x7f01f013f790 2024-04-25T15:20:48.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7fd7667fc640 1 -- 172.21.15.33:0/369532292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c037070 con 0x7fd7600382c0 2024-04-25T15:20:48.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612ede0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61280af8e0 con 0x7f61280b5580 2024-04-25T15:20:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7fd7667fc640 1 -- 172.21.15.33:0/369532292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75c032440 con 0x7fd7600382c0 2024-04-25T15:20:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612ede0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61280afbe0 con 0x7f612806e370 2024-04-25T15:20:48.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f95a2d9d640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f958c005150 0x7f958c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612d5dd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806e370 0x7f61281f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612d5dd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806e370 0x7f61281f4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45448/0 (socket says 172.21.15.33:45448) 2024-04-25T15:20:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7fd7667fc640 1 -- 172.21.15.33:0/369532292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c032810 con 0x7fd7600382c0 2024-04-25T15:20:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.149+0000 7f618db4d640 1 -- start start 2024-04-25T15:20:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f618db4d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61880b2760 0x7f618806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f618db4d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6188140840 0x7f6188149980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f618db4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 0x7f6188072500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f618db4d640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f61880b8360 con 0x7f6188140840 2024-04-25T15:20:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f618db4d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f61880b7b60 con 0x7f61880b2760 2024-04-25T15:20:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f618db4d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61880b7e40 con 0x7f6188149ec0 2024-04-25T15:20:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f95a1d9b640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f958c004800 0x7f958c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f171759e640 1 -- 172.21.15.33:0/4046818231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17100396b0 msgr2=0x7f171003a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f171759e640 1 --2- 172.21.15.33:0/4046818231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17100396b0 0x7f171003a6b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f171003cbe0 tx=0x7f170c02e600 comp rx=0 tx=0).stop 2024-04-25T15:20:48.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f6186ffd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6188140840 0x7f6188149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f61877fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61880b2760 0x7f618806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.189 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f61877fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61880b2760 0x7f618806d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:50948/0 (socket says 172.21.15.33:50948) 2024-04-25T15:20:48.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f171759e640 1 -- 172.21.15.33:0/4046818231 shutdown_connections 2024-04-25T15:20:48.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f171759e640 1 --2- 172.21.15.33:0/4046818231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17100396b0 0x7f171003a6b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f171759e640 1 --2- 172.21.15.33:0/4046818231 >> v2:172.21.15.33:3300/0 conn(0x7f17100323c0 0x7f17100cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f171759e640 1 -- 172.21.15.33:0/4046818231 >> 172.21.15.33:0/4046818231 conn(0x7f171003b7b0 msgr2=0x7f171003bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f95a2d9d640 1 -- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f958c0039b0 msgr2=0x7f958c003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:20:48.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f95a2d9d640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f958c0039b0 0x7f958c003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f95a2d9d640 1 -- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f958c004800 msgr2=0x7f958c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f95a2d9d640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f958c004800 0x7f958c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f95a2d9d640 1 -- 172.21.15.33:0/304031433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c003520 con 0x7f958c005150 2024-04-25T15:20:48.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f61877fe640 1 -- 172.21.15.33:0/4149843887 learned_addr learned my addr 172.21.15.33:0/4149843887 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f171759e640 1 -- 172.21.15.33:0/4046818231 shutdown_connections 2024-04-25T15:20:48.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f171759e640 1 -- 172.21.15.33:0/4046818231 wait complete. 2024-04-25T15:20:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f01eeffd640 1 --2- 172.21.15.33:0/1408095632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f013f790 0x7f01f0145cc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01e40097d0 tx=0x7f01e4029f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d29eafe215ff1b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f61877fe640 1 -- 172.21.15.33:0/4149843887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 msgr2=0x7f6188072500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:20:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.150+0000 7f612e5df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61280b5580 0x7f6128096910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f612e5df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61280b5580 0x7f6128096910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:50936/0 (socket says 172.21.15.33:50936) 2024-04-25T15:20:48.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f612e5df640 1 -- 172.21.15.33:0/2056961731 learned_addr learned my addr 172.21.15.33:0/2056961731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7fd76ca30640 1 -- 172.21.15.33:0/369532292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600382c0 msgr2=0x7fd7600dbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7fd76ca30640 1 --2- 172.21.15.33:0/369532292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600382c0 0x7fd7600dbb70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009870 tx=0x7fd75c02a180 comp rx=0 tx=0).stop 2024-04-25T15:20:48.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f612ddde640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f612806df60 0x7f6128153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7feb44856640 1 -- 172.21.15.33:0/617570541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380c9ce0 msgr2=0x7feb380ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7feb44856640 1 --2- 172.21.15.33:0/617570541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380c9ce0 0x7feb380ca0f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb40066010 tx=0x7feb400a7130 comp rx=0 tx=0).stop 2024-04-25T15:20:48.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7fd76ca30640 1 -- 172.21.15.33:0/369532292 shutdown_connections 2024-04-25T15:20:48.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7fd76ca30640 1 --2- 172.21.15.33:0/369532292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600382c0 0x7fd7600dbb70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7fd76ca30640 1 --2- 172.21.15.33:0/369532292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 0x7fd760039440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7fd76ca30640 1 -- 172.21.15.33:0/369532292 >> 172.21.15.33:0/369532292 conn(0x7fd7600063a0 msgr2=0x7fd7600067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f61877fe640 1 --2- 172.21.15.33:0/4149843887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 0x7f6188072500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.151+0000 7f61877fe640 1 -- 172.21.15.33:0/4149843887 >> v2:172.21.15.33:3300/0 conn(0x7f6188140840 msgr2=0x7f6188149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f612e5df640 1 -- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806e370 msgr2=0x7f61281f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f612e5df640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f612806e370 0x7f61281f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f612e5df640 1 -- 172.21.15.33:0/2056961731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f612806df60 msgr2=0x7f6128153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f01ee7fc640 1 -- 172.21.15.33:0/1408095632 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4037070 con 0x7f01f013f790 2024-04-25T15:20:48.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f01ee7fc640 1 -- 172.21.15.33:0/1408095632 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e402ac20 con 0x7f01f013f790 2024-04-25T15:20:48.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f612e5df640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f612806df60 0x7f6128153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f612e5df640 1 -- 172.21.15.33:0/2056961731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612809bcf0 con 0x7f61280b5580 2024-04-25T15:20:48.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f01ee7fc640 1 -- 172.21.15.33:0/1408095632 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4032440 con 0x7f01f013f790 2024-04-25T15:20:48.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7fd76ca30640 1 -- 172.21.15.33:0/369532292 shutdown_connections 2024-04-25T15:20:48.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1886276014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 msgr2=0x7f1c840b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7fd76ca30640 1 -- 172.21.15.33:0/369532292 wait complete. 2024-04-25T15:20:48.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f1c8afb1640 1 --2- 172.21.15.33:0/1886276014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 0x7f1c840b0ca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c84145640 tx=0x7f1c7c02ca70 comp rx=0 tx=0).stop 2024-04-25T15:20:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f61877fe640 1 --2- 172.21.15.33:0/4149843887 >> v2:172.21.15.33:3300/0 conn(0x7f6188140840 0x7f6188149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f61877fe640 1 -- 172.21.15.33:0/4149843887 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61880b7480 con 0x7f61880b2760 2024-04-25T15:20:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f6186ffd640 1 --2- 172.21.15.33:0/4149843887 >> v2:172.21.15.33:3300/0 conn(0x7f6188140840 0x7f6188149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7feb44856640 1 -- 172.21.15.33:0/617570541 shutdown_connections 2024-04-25T15:20:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7feb44856640 1 --2- 172.21.15.33:0/617570541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb380c9ce0 0x7feb380ca0f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7feb44856640 1 --2- 172.21.15.33:0/617570541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb38029ca0 0x7feb38034870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7feb44856640 1 -- 172.21.15.33:0/617570541 >> 172.21.15.33:0/617570541 conn(0x7feb38006270 msgr2=0x7feb38006680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1886276014 shutdown_connections 2024-04-25T15:20:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7feb44856640 1 -- 172.21.15.33:0/617570541 shutdown_connections 2024-04-25T15:20:48.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7feb44856640 1 -- 172.21.15.33:0/617570541 wait complete. 2024-04-25T15:20:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f612e5df640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61280b5580 0x7f6128096910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f612400bbc0 tx=0x7f6124004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f1c8afb1640 1 --2- 172.21.15.33:0/1886276014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 0x7f1c840b0ca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f1c8afb1640 1 --2- 172.21.15.33:0/1886276014 >> v2:172.21.15.33:3300/0 conn(0x7f1c84145860 0x7f1c84145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.152+0000 7f95a2d9d640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f958c005150 0x7f958c00b9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f959800aa10 tx=0x7f958c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b67d7ff4f8df52f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612403c030 con 0x7f61280b5580 2024-04-25T15:20:48.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1886276014 >> 172.21.15.33:0/1886276014 conn(0x7f1c840ba640 msgr2=0x7f1c840baa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6124040410 con 0x7f61280b5580 2024-04-25T15:20:48.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f01f5ccd640 1 -- 172.21.15.33:0/1408095632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f013f790 msgr2=0x7f01f0145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598036070 con 0x7f958c005150 2024-04-25T15:20:48.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f01f5ccd640 1 --2- 172.21.15.33:0/1408095632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f013f790 0x7f01f0145cc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01e40097d0 tx=0x7f01e4029f90 comp rx=0 tx=0).stop 2024-04-25T15:20:48.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f61877fe640 1 --2- 172.21.15.33:0/4149843887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61880b2760 0x7f618806d5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61880bb970 tx=0x7f617002a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a83f52bf09a861fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f171759e640 1 Processor -- start 2024-04-25T15:20:48.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f612ede0640 1 -- 172.21.15.33:0/2056961731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6128099b50 con 0x7f61280b5580 2024-04-25T15:20:48.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f171759e640 1 -- start start 2024-04-25T15:20:48.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f612ede0640 1 -- 172.21.15.33:0/2056961731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612809c120 con 0x7f61280b5580 2024-04-25T15:20:48.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f61867fc640 1 -- 172.21.15.33:0/4149843887 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170037070 con 0x7f61880b2760 2024-04-25T15:20:48.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f61867fc640 1 -- 172.21.15.33:0/4149843887 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617002ae20 con 0x7f61880b2760 2024-04-25T15:20:48.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f61867fc640 1 -- 172.21.15.33:0/4149843887 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170037070 con 0x7f61880b2760 2024-04-25T15:20:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124040800 con 0x7f61280b5580 2024-04-25T15:20:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f612ede0640 1 -- 172.21.15.33:0/2056961731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6128076c00 con 0x7f61280b5580 2024-04-25T15:20:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7feb44856640 1 Processor -- start 2024-04-25T15:20:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9598031600 con 0x7f958c005150 2024-04-25T15:20:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.153+0000 7f95a159a640 1 -- 172.21.15.33:0/304031433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598036070 con 0x7f958c005150 2024-04-25T15:20:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f95a8df3640 1 -- 172.21.15.33:0/304031433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f958c005150 msgr2=0x7f958c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f95a8df3640 1 --2- 172.21.15.33:0/304031433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f958c005150 0x7f958c00b9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f959800aa10 tx=0x7f958c005830 comp rx=0 tx=0).stop 2024-04-25T15:20:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.154+0000 7f95a2d9d640 1 -- 172.21.15.33:0/304031433 reap_dead start 2024-04-25T15:20:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f95a8df3640 1 -- 172.21.15.33:0/304031433 shutdown_connections 2024-04-25T15:20:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f95a8df3640 1 -- 172.21.15.33:0/304031433 >> 172.21.15.33:0/304031433 conn(0x7f95a406e5d0 msgr2=0x7f95a406e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7fd76ca30640 1 Processor -- start 2024-04-25T15:20:48.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f01f5ccd640 1 -- 172.21.15.33:0/1408095632 shutdown_connections 2024-04-25T15:20:48.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f01f5ccd640 1 --2- 172.21.15.33:0/1408095632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f013f790 0x7f01f0145cc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f01f5ccd640 1 -- 172.21.15.33:0/1408095632 >> 172.21.15.33:0/1408095632 conn(0x7f01f006cbf0 msgr2=0x7f01f00ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f95a8df3640 1 -- 172.21.15.33:0/304031433 shutdown_connections 2024-04-25T15:20:48.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7fd76ca30640 1 -- start start 2024-04-25T15:20:48.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1886276014 shutdown_connections 2024-04-25T15:20:48.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f01f5ccd640 1 -- 172.21.15.33:0/1408095632 shutdown_connections 2024-04-25T15:20:48.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7feb44856640 1 -- start start 2024-04-25T15:20:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f171759e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17100323c0 0x7f17100c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f171759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17100396b0 0x7f171015ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f618db4d640 1 -- 172.21.15.33:0/4149843887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61880b2760 msgr2=0x7f618806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f618db4d640 1 --2- 172.21.15.33:0/4149843887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61880b2760 0x7f618806d5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61880bb970 tx=0x7f617002a0d0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f171759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f171003abf0 0x7f1710038710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f171759e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f17100c40a0 con 0x7f17100323c0 2024-04-25T15:20:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f618db4d640 1 -- 172.21.15.33:0/4149843887 shutdown_connections 2024-04-25T15:20:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f618db4d640 1 --2- 172.21.15.33:0/4149843887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 0x7f6188072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f618db4d640 1 --2- 172.21.15.33:0/4149843887 >> v2:172.21.15.33:3300/0 conn(0x7f6188140840 0x7f6188149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f618db4d640 1 --2- 172.21.15.33:0/4149843887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61880b2760 0x7f618806d5d0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61880bb970 tx=0x7f617002a0d0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f618db4d640 1 -- 172.21.15.33:0/4149843887 >> 172.21.15.33:0/4149843887 conn(0x7f618806f4c0 msgr2=0x7f618806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f171759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17100c3f20 con 0x7f171003abf0 2024-04-25T15:20:48.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f618db4d640 1 -- 172.21.15.33:0/4149843887 shutdown_connections 2024-04-25T15:20:48.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f171759e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f17100c4220 con 0x7f17100396b0 2024-04-25T15:20:48.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f95a8df3640 1 -- 172.21.15.33:0/304031433 wait complete. 2024-04-25T15:20:48.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f61240409a0 con 0x7f61280b5580 2024-04-25T15:20:48.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f1715d9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17100396b0 0x7f171015ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f171659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17100323c0 0x7f17100c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f1716d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f171003abf0 0x7f1710038710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f171659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17100323c0 0x7f17100c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51128/0 (socket says 172.21.15.33:51128) 2024-04-25T15:20:48.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f171659c640 1 -- 172.21.15.33:0/2121350618 learned_addr learned my addr 172.21.15.33:0/2121350618 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f618db4d640 1 -- 172.21.15.33:0/4149843887 wait complete. 2024-04-25T15:20:48.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.155+0000 7f01f5ccd640 1 -- 172.21.15.33:0/1408095632 wait complete. 2024-04-25T15:20:48.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f611e7fc640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f610c074580 0x7f610c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.156+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f61240b4fa0 con 0x7f61280b5580 2024-04-25T15:20:48.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f611e7fc640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f610c07c7d0 0x7f610c07ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 --> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6124011ea0 con 0x7f610c07c7d0 2024-04-25T15:20:48.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1715d9b640 1 -- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f171003abf0 msgr2=0x7f1710038710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1715d9b640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f171003abf0 0x7f1710038710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1715d9b640 1 -- 172.21.15.33:0/2121350618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17100323c0 msgr2=0x7f17100c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1715d9b640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17100323c0 0x7f17100c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1715d9b640 1 -- 172.21.15.33:0/2121350618 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171015f150 con 0x7f17100396b0 2024-04-25T15:20:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7fd76ca30640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7600382c0 0x7fd76002e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f612407b6f0 con 0x7f61280b5580 2024-04-25T15:20:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1715d9b640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17100396b0 0x7f171015ec10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f170c035000 tx=0x7f170c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1886276014 wait complete. 2024-04-25T15:20:48.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f612ddde640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f610c074580 0x7f610c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7fd76ca30640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd760039980 0x7fd76016ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c045030 con 0x7f17100396b0 2024-04-25T15:20:48.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7fd7677fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7600382c0 0x7fd76002e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f612d5dd640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f610c07c7d0 0x7f610c07ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c004020 con 0x7f17100396b0 2024-04-25T15:20:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.157+0000 7fd7677fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7600382c0 0x7fd76002e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:50962/0 (socket says 172.21.15.33:50962) 2024-04-25T15:20:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17100c60d0 con 0x7f17100396b0 2024-04-25T15:20:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7fd7677fe640 1 -- 172.21.15.33:0/33832899 learned_addr learned my addr 172.21.15.33:0/33832899 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7feb44856640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb38029ca0 0x7feb38161710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7f01f5ccd640 1 Processor -- start 2024-04-25T15:20:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17100361d0 con 0x7f17100396b0 2024-04-25T15:20:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7f95a8df3640 1 Processor -- start 2024-04-25T15:20:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7feb44856640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb38039a80 0x7feb380bf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7fd76ca30640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 0x7fd7600d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7f95a8df3640 1 -- start start 2024-04-25T15:20:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd76003dfc0 con 0x7fd760039980 2024-04-25T15:20:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7feb44856640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb380c9ce0 0x7feb380bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7600363a0 con 0x7fd7600382c0 2024-04-25T15:20:48.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7feb3effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb38039a80 0x7feb380bf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7feb3effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb38039a80 0x7feb380bf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:50968/0 (socket says 172.21.15.33:50968) 2024-04-25T15:20:48.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7feb3effd640 1 -- 172.21.15.33:0/1739500589 learned_addr learned my addr 172.21.15.33:0/1739500589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd76003c360 con 0x7fd76003dbb0 2024-04-25T15:20:48.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7fd767fff640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 0x7fd7600d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.158+0000 7f01f5ccd640 1 -- start start 2024-04-25T15:20:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7feb3ffff640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb380c9ce0 0x7feb380bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f618db4d640 1 Processor -- start 2024-04-25T15:20:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7fd7677fe640 1 -- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 msgr2=0x7fd7600d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7fd7677fe640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd76003dbb0 0x7fd7600d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7fd7677fe640 1 -- 172.21.15.33:0/33832899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd760039980 msgr2=0x7fd76016ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7fd7677fe640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd760039980 0x7fd76016ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7fd7677fe640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76016b2b0 con 0x7fd7600382c0 2024-04-25T15:20:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7feb3f7fe640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb38029ca0 0x7feb38161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7feb44856640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7feb3803a1f0 con 0x7feb38029ca0 2024-04-25T15:20:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7feb44856640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb3802a810 con 0x7feb38039a80 2024-04-25T15:20:48.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7feb44856640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb38035030 con 0x7feb380c9ce0 2024-04-25T15:20:48.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f612d5dd640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f610c07c7d0 0x7f610c07ec20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c03a040 con 0x7f17100396b0 2024-04-25T15:20:48.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f95a8df3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f958c005150 0x7f95a41446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.229 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f95a8df3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a4143670 0x7f95a41ded20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f95a8df3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a41df260 0x7f95a41db1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f95a8df3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f95a40b1d00 con 0x7f95a4143670 2024-04-25T15:20:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f95a8df3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95a4149c20 con 0x7f95a41df260 2024-04-25T15:20:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.159+0000 7f95a8df3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95a40b1e80 con 0x7f958c005150 2024-04-25T15:20:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01f5ccd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f006d000 0x7f01f0140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01f5ccd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f013f790 0x7f01f0142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01ef7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f006d000 0x7f01f0140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01ef7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f006d000 0x7f01f0140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45500/0 (socket says 172.21.15.33:45500) 2024-04-25T15:20:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01ef7fe640 1 -- 172.21.15.33:0/4170648744 learned_addr learned my addr 172.21.15.33:0/4170648744 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01f5ccd640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f013fba0 0x7f01f01430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01eeffd640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f013f790 0x7f01f0142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f01f00724c0 con 0x7f01f013f790 2024-04-25T15:20:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01f0146450 con 0x7f01f013fba0 2024-04-25T15:20:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01f0072640 con 0x7f01f006d000 2024-04-25T15:20:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f01effff640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f013fba0 0x7f01f01430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 <== osd.2 v2:172.21.15.33:6816/1934245664 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6124011ea0 con 0x7f610c07c7d0 2024-04-25T15:20:48.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7feb3f7fe640 1 -- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb380c9ce0 msgr2=0x7feb380bcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7feb3f7fe640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb380c9ce0 0x7feb380bcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7feb3f7fe640 1 -- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb38039a80 msgr2=0x7feb380bf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7feb3f7fe640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb38039a80 0x7feb380bf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7feb3f7fe640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb380cc2c0 con 0x7feb38029ca0 2024-04-25T15:20:48.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7feb3f7fe640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb38029ca0 0x7feb38161710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb3400e840 tx=0x7feb3400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34017070 con 0x7feb38029ca0 2024-04-25T15:20:48.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f1c8afb1640 1 Processor -- start 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a4143670 0x7f95a41ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a259c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f958c005150 0x7f95a41446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a4143670 0x7f95a41ded20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51166/0 (socket says 172.21.15.33:51166) 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 -- 172.21.15.33:0/142836592 learned_addr learned my addr 172.21.15.33:0/142836592 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 -- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f958c005150 msgr2=0x7f95a41446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f958c005150 0x7f95a41446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 -- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a41df260 msgr2=0x7f95a41db1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a41df260 0x7f95a41db1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 -- 172.21.15.33:0/142836592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a41de750 con 0x7f95a4143670 2024-04-25T15:20:48.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f95a1d9b640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a4143670 0x7f95a41ded20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f959400e7b0 tx=0x7f959400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f612ddde640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f610c074580 0x7f610c076a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6118006fd0 tx=0x7f6118008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7feb44856640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb380cb340 con 0x7feb38029ca0 2024-04-25T15:20:48.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7feb44856640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb380cab90 con 0x7feb38029ca0 2024-04-25T15:20:48.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3400c730 con 0x7feb38029ca0 2024-04-25T15:20:48.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3400cae0 con 0x7feb38029ca0 2024-04-25T15:20:48.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7fd7677fe640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7600382c0 0x7fd76002e250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c7f0 tx=0x7fd75400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f01ef7fe640 1 -- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f013fba0 msgr2=0x7f01f01430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f01ef7fe640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f013fba0 0x7f01f01430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f01ef7fe640 1 -- 172.21.15.33:0/4170648744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f013f790 msgr2=0x7f01f0142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f01ef7fe640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f013f790 0x7f01f0142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f01ef7fe640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f01dc3f0 con 0x7f01f006d000 2024-04-25T15:20:48.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754015070 con 0x7fd7600382c0 2024-04-25T15:20:48.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd754004220 con 0x7fd7600382c0 2024-04-25T15:20:48.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f618db4d640 1 -- start start 2024-04-25T15:20:48.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7f1c8afb1640 1 -- start start 2024-04-25T15:20:48.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959400ee60 con 0x7f95a4143670 2024-04-25T15:20:48.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9594018070 con 0x7f95a4143670 2024-04-25T15:20:48.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959400c6c0 con 0x7f95a4143670 2024-04-25T15:20:48.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a41df670 con 0x7f95a4143670 2024-04-25T15:20:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a41454d0 con 0x7f95a4143670 2024-04-25T15:20:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.160+0000 7f1704ff9640 1 -- 172.21.15.33:0/2121350618 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f16f0001030 con 0x7f17100396b0 2024-04-25T15:20:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f170c048070 con 0x7f17100396b0 2024-04-25T15:20:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f1706ffd640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f16f80745b0 0x7f16f8076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f170c0b99a0 con 0x7f17100396b0 2024-04-25T15:20:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7f1706ffd640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7f16f807c800 0x7f16f807ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7f1716d9d640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7f16f807c800 0x7f16f807ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.161+0000 7f618db4d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6188140840 0x7f618813bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f1716d9d640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7f16f807c800 0x7f16f807ec50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 --> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f170c033510 con 0x7f16f807c800 2024-04-25T15:20:48.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f618db4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 0x7f6188132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754003610 con 0x7fd7600382c0 2024-04-25T15:20:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7600d13c0 con 0x7fd7600382c0 2024-04-25T15:20:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76016a570 con 0x7fd7600382c0 2024-04-25T15:20:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f01ef7fe640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f006d000 0x7f01f0140210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c5a0 tx=0x7f01e000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0017070 con 0x7f01f006d000 2024-04-25T15:20:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e00074e0 con 0x7f01f006d000 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f170c0801b0 con 0x7f17100396b0 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f171659c640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f16f80745b0 0x7f16f8076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f618db4d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61881e07d0 0x7f61880b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f618db4d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f61880b6940 con 0x7f61881e07d0 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f618db4d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61880b67c0 con 0x7f6188140840 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f618db4d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6188072a40 con 0x7f6188149ec0 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f6186ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 0x7f6188132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f6186ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 0x7f6188132ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45514/0 (socket says 172.21.15.33:45514) 2024-04-25T15:20:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f6186ffd640 1 -- 172.21.15.33:0/538763886 learned_addr learned my addr 172.21.15.33:0/538763886 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.162+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb380cc070 con 0x7feb38029ca0 2024-04-25T15:20:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f1c8afb1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c840af660 0x7f1c84073a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c8afb1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 0x7f1c840b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c8afb1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c84145860 0x7f1c841e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c8afb1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8409fbb0 con 0x7f1c840af660 2024-04-25T15:20:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c89faf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c840af660 0x7f1c84073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c89faf640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c840af660 0x7f1c84073a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51172/0 (socket says 172.21.15.33:51172) 2024-04-25T15:20:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c89faf640 1 -- 172.21.15.33:0/1709445020 learned_addr learned my addr 172.21.15.33:0/1709445020 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.163+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95a40b5290 con 0x7f95a4143670 2024-04-25T15:20:48.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c8a7b0640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c84145860 0x7f1c841e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c8afb1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8409fa30 con 0x7f1c840b0890 2024-04-25T15:20:48.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1c8406f870 con 0x7f1c84145860 2024-04-25T15:20:48.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f6186ffd640 1 -- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6188140840 msgr2=0x7f618813bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f6186ffd640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6188140840 0x7f618813bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f6186ffd640 1 -- 172.21.15.33:0/538763886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61881e07d0 msgr2=0x7f61880b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 <== osd.3 v2:172.21.15.33:6808/2009635003 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f170c033510 con 0x7f16f807c800 2024-04-25T15:20:48.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f1c897ae640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 0x7f1c840b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f6186ffd640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61881e07d0 0x7f61880b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.164+0000 7f6186ffd640 1 -- 172.21.15.33:0/538763886 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6188133530 con 0x7f6188149ec0 2024-04-25T15:20:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7600059c0 con 0x7fd7600382c0 2024-04-25T15:20:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e00049e0 con 0x7f01f006d000 2024-04-25T15:20:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f0141280 con 0x7f01f006d000 2024-04-25T15:20:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f01dbbf0 con 0x7f01f006d000 2024-04-25T15:20:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f6186ffd640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 0x7f6188132ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6178007f20 tx=0x7f617800d560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f1c897ae640 1 -- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c84145860 msgr2=0x7f1c841e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f1c897ae640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c84145860 0x7f1c841e3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f1c897ae640 1 -- 172.21.15.33:0/1709445020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c840af660 msgr2=0x7f1c84073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f1c897ae640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c840af660 0x7f1c84073a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f1c897ae640 1 -- 172.21.15.33:0/1709445020 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c841e36f0 con 0x7f1c840b0890 2024-04-25T15:20:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f171659c640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f16f80745b0 0x7f16f8076ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f171802e0e0 tx=0x7f1718051110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd7540039c0 con 0x7fd7600382c0 2024-04-25T15:20:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7f1c897ae640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 0x7f1c840b3500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400e840 tx=0x7f1c7400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617801a070 con 0x7f6188149ec0 2024-04-25T15:20:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c74017070 con 0x7f1c840b0890 2024-04-25T15:20:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7400c6b0 con 0x7f1c840b0890 2024-04-25T15:20:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400ca60 con 0x7f1c840b0890 2024-04-25T15:20:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61881e0cf0 con 0x7f6188149ec0 2024-04-25T15:20:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61881e0300 con 0x7f6188149ec0 2024-04-25T15:20:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6178003b90 con 0x7f6188149ec0 2024-04-25T15:20:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178004030 con 0x7f6188149ec0 2024-04-25T15:20:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c840b3a40 con 0x7f1c840b0890 2024-04-25T15:20:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.165+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb3401a070 con 0x7feb38029ca0 2024-04-25T15:20:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7feb2bfff640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7feb240744b0 0x7feb240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feb340957f0 con 0x7feb38029ca0 2024-04-25T15:20:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7feb2bfff640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7feb2407c700 0x7feb2407eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb3401fe70 con 0x7feb2407c700 2024-04-25T15:20:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feb34095be0 con 0x7feb38029ca0 2024-04-25T15:20:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7fd753fff640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd74c074500 0x7fd74c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd754095480 con 0x7fd7600382c0 2024-04-25T15:20:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7fd753fff640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7fd74c07c7d0 0x7fd74c07ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd754003e50 con 0x7fd74c07c7d0 2024-04-25T15:20:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd75409c050 con 0x7fd7600382c0 2024-04-25T15:20:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f959400c860 con 0x7f95a4143670 2024-04-25T15:20:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7f9592ffd640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9584074580 0x7f9584076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.166+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c840b1e90 con 0x7f1c840b0890 2024-04-25T15:20:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7fd767fff640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7fd74c07c7d0 0x7fd74c07ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9594095bf0 con 0x7f95a4143670 2024-04-25T15:20:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7f95a259c640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9584074580 0x7f9584076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7f9592ffd640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7f958407c850 0x7f958407eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 --> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9594003e50 con 0x7f958407c850 2024-04-25T15:20:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9594095fe0 con 0x7f95a4143670 2024-04-25T15:20:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f616c001030 con 0x7f6188149ec0 2024-04-25T15:20:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7f95a259c640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9584074580 0x7f9584076a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95a4070a20 tx=0x7f959c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01f0141030 con 0x7f01f006d000 2024-04-25T15:20:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7feb3effd640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7feb240744b0 0x7feb240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7feb3ffff640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7feb2407c700 0x7feb2407eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7feb3effd640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7feb240744b0 0x7feb240769c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb380c5ed0 tx=0x7feb2c0015e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7feb3ffff640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7feb2407c700 0x7feb2407eb50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c84076c00 con 0x7f1c840b0890 2024-04-25T15:20:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f617801d070 con 0x7f6188149ec0 2024-04-25T15:20:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.167+0000 7fd766ffd640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd74c074500 0x7fd74c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7fd766ffd640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd74c074500 0x7fd74c076a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd768052040 tx=0x7fd7680662a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f01e001a070 con 0x7f01f006d000 2024-04-25T15:20:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.168+0000 7f95a2d9d640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7f958407c850 0x7f958407eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1c7401a070 con 0x7f1c840b0890 2024-04-25T15:20:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f617ffff640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6168074580 0x7f6168076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7fd767fff640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7fd74c07c7d0 0x7fd74c07ec20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6178095340 con 0x7f6188149ec0 2024-04-25T15:20:48.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f61877fe640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6168074580 0x7f6168076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f95a2d9d640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7f958407c850 0x7f958407eca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f01d7fff640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f01dc074580 0x7f01dc076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f01e00945c0 con 0x7f01f006d000 2024-04-25T15:20:48.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f01d7fff640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f01dc07c850 0x7f01dc07eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01e0020e50 con 0x7f01dc07c850 2024-04-25T15:20:48.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f01e009b050 con 0x7f01f006d000 2024-04-25T15:20:48.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f617ffff640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f616807c850 0x7f616807eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 --> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f616807f370 con 0x7f616807c850 2024-04-25T15:20:48.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f617809c050 con 0x7f6188149ec0 2024-04-25T15:20:48.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f01eeffd640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f01dc074580 0x7f01dc076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.169+0000 7f1c7a7fc640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1c680744e0 0x7f1c680769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f01effff640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f01dc07c850 0x7f01dc07eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f6187fff640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f616807c850 0x7f616807eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c74094eb0 con 0x7f1c840b0890 2024-04-25T15:20:48.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f1c89faf640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1c680744e0 0x7f1c680769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f1c7a7fc640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f1c6807c730 0x7f1c6807eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 --> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c6807f250 con 0x7f1c6807c730 2024-04-25T15:20:48.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1c7405aea0 con 0x7f1c840b0890 2024-04-25T15:20:48.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 <== osd.5 v2:172.21.15.155:6800/753631458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb3401fe70 con 0x7feb2407c700 2024-04-25T15:20:48.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f61877fe640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6168074580 0x7f6168076a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6170034000 tx=0x7f617002c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f1c8a7b0640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f1c6807c730 0x7f1c6807eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f6187fff640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f616807c850 0x7f616807eca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 <== osd.7 v2:172.21.15.155:6809/1726313221 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9594003e50 con 0x7f958407c850 2024-04-25T15:20:48.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.170+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 <== osd.0 v2:172.21.15.33:6824/3758744180 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd754003e50 con 0x7fd74c07c7d0 2024-04-25T15:20:48.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.171+0000 7f01effff640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f01dc07c850 0x7f01dc07eca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.171+0000 7f01eeffd640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f01dc074580 0x7f01dc076a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01e4034000 tx=0x7f01e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.171+0000 7f1c8a7b0640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f1c6807c730 0x7f1c6807eb80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.171+0000 7f1c89faf640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1c680744e0 0x7f1c680769f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007fd0 tx=0x7f1c80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.171+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 <== osd.4 v2:172.21.15.155:6824/136572947 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f616807f370 con 0x7f616807c850 2024-04-25T15:20:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.172+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 <== osd.6 v2:172.21.15.155:6808/1724039057 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c6807f250 con 0x7f1c6807c730 2024-04-25T15:20:48.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.172+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 <== osd.1 v2:172.21.15.33:6800/3783939985 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01e0020e50 con 0x7f01dc07c850 2024-04-25T15:20:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.194+0000 7f612ede0640 1 -- 172.21.15.33:0/2056961731 --> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6128071d00 con 0x7f610c07c7d0 2024-04-25T15:20:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.195+0000 7f611e7fc640 1 -- 172.21.15.33:0/2056961731 <== osd.2 v2:172.21.15.33:6816/1934245664 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6128071d00 con 0x7f610c07c7d0 2024-04-25T15:20:48.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.196+0000 7f610bfff640 1 -- 172.21.15.33:0/2056961731 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f610c07c7d0 msgr2=0x7f610c07ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.196+0000 7f610bfff640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f610c07c7d0 0x7f610c07ec20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.196+0000 7f610bfff640 1 -- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f610c074580 msgr2=0x7f610c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.196+0000 7f610bfff640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f610c074580 0x7f610c076a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6118006fd0 tx=0x7f6118008040 comp rx=0 tx=0).stop 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.196+0000 7f610bfff640 1 -- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61280b5580 msgr2=0x7f6128096910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.196+0000 7f610bfff640 1 --2- 172.21.15.33:0/2056961731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61280b5580 0x7f6128096910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f612400bbc0 tx=0x7f6124004730 comp rx=0 tx=0).stop 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.196+0000 7f612e5df640 1 -- 172.21.15.33:0/2056961731 reap_dead start 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.197+0000 7f610bfff640 1 -- 172.21.15.33:0/2056961731 shutdown_connections 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.197+0000 7f610bfff640 1 -- 172.21.15.33:0/2056961731 >> 172.21.15.33:0/2056961731 conn(0x7f61280ba640 msgr2=0x7f61280b7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.197+0000 7f610bfff640 1 -- 172.21.15.33:0/2056961731 shutdown_connections 2024-04-25T15:20:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.197+0000 7f610bfff640 1 -- 172.21.15.33:0/2056961731 wait complete. 2024-04-25T15:20:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.199+0000 7f1704ff9640 1 -- 172.21.15.33:0/2121350618 --> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f16f0002dd0 con 0x7f16f807c800 2024-04-25T15:20:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.200+0000 7f1706ffd640 1 -- 172.21.15.33:0/2121350618 <== osd.3 v2:172.21.15.33:6808/2009635003 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f16f0002dd0 con 0x7f16f807c800 2024-04-25T15:20:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.201+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7f16f807c800 msgr2=0x7f16f807ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.201+0000 7f171759e640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7f16f807c800 0x7f16f807ec50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.201+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f16f80745b0 msgr2=0x7f16f8076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.201+0000 7f171759e640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f16f80745b0 0x7f16f8076ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f171802e0e0 tx=0x7f1718051110 comp rx=0 tx=0).stop 2024-04-25T15:20:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.201+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17100396b0 msgr2=0x7f171015ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.201+0000 7f171759e640 1 --2- 172.21.15.33:0/2121350618 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17100396b0 0x7f171015ec10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f170c035000 tx=0x7f170c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.202+0000 7f1716d9d640 1 -- 172.21.15.33:0/2121350618 reap_dead start 2024-04-25T15:20:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.202+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 shutdown_connections 2024-04-25T15:20:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.202+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 >> 172.21.15.33:0/2121350618 conn(0x7f171003b7b0 msgr2=0x7f171003e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.202+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 shutdown_connections 2024-04-25T15:20:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.202+0000 7f171759e640 1 -- 172.21.15.33:0/2121350618 wait complete. 2024-04-25T15:20:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.204+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 --> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd760041110 con 0x7fd74c07c7d0 2024-04-25T15:20:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.204+0000 7fd753fff640 1 -- 172.21.15.33:0/33832899 <== osd.0 v2:172.21.15.33:6824/3758744180 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd760041110 con 0x7fd74c07c7d0 2024-04-25T15:20:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.204+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 --> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f95a40b5480 con 0x7f958407c850 2024-04-25T15:20:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.204+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 --> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb380cc070 con 0x7feb2407c700 2024-04-25T15:20:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7f9592ffd640 1 -- 172.21.15.33:0/142836592 <== osd.7 v2:172.21.15.155:6809/1726313221 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f95a40b5480 con 0x7f958407c850 2024-04-25T15:20:48.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 --> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f616c002dd0 con 0x7f616807c850 2024-04-25T15:20:48.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 --> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c840b6060 con 0x7f1c6807c730 2024-04-25T15:20:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7fd74c07c7d0 msgr2=0x7fd74c07ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7fd76ca30640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7fd74c07c7d0 0x7fd74c07ec20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 --> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f01f01d19c0 con 0x7f01dc07c850 2024-04-25T15:20:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7f958407c850 msgr2=0x7f958407eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7f95a8df3640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7f958407c850 0x7f958407eca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7feb2bfff640 1 -- 172.21.15.33:0/1739500589 <== osd.5 v2:172.21.15.155:6800/753631458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb380cc070 con 0x7feb2407c700 2024-04-25T15:20:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd74c074500 msgr2=0x7fd74c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7fd76ca30640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd74c074500 0x7fd74c076a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd768052040 tx=0x7fd7680662a0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7600382c0 msgr2=0x7fd76002e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7fd76ca30640 1 --2- 172.21.15.33:0/33832899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7600382c0 0x7fd76002e250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd75400c7f0 tx=0x7fd75400ccb0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7fd767fff640 1 -- 172.21.15.33:0/33832899 reap_dead start 2024-04-25T15:20:48.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.205+0000 7f617ffff640 1 -- 172.21.15.33:0/538763886 <== osd.4 v2:172.21.15.155:6824/136572947 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f616c002dd0 con 0x7f616807c850 2024-04-25T15:20:48.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9584074580 msgr2=0x7f9584076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a8df3640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9584074580 0x7f9584076a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95a4070a20 tx=0x7f959c009040 comp rx=0 tx=0).stop 2024-04-25T15:20:48.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a4143670 msgr2=0x7f95a41ded20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a8df3640 1 --2- 172.21.15.33:0/142836592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a4143670 0x7f95a41ded20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f959400e7b0 tx=0x7f959400ec70 comp rx=0 tx=0).stop 2024-04-25T15:20:48.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f1c7a7fc640 1 -- 172.21.15.33:0/1709445020 <== osd.6 v2:172.21.15.155:6808/1724039057 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1c840b6060 con 0x7f1c6807c730 2024-04-25T15:20:48.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f01d7fff640 1 -- 172.21.15.33:0/4170648744 <== osd.1 v2:172.21.15.33:6800/3783939985 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f01e8001b00 con 0x7f01dc07c850 2024-04-25T15:20:48.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a2d9d640 1 -- 172.21.15.33:0/142836592 reap_dead start 2024-04-25T15:20:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 shutdown_connections 2024-04-25T15:20:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 >> 172.21.15.33:0/142836592 conn(0x7f95a406e5d0 msgr2=0x7f95a40afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7feb2407c700 msgr2=0x7feb2407eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 shutdown_connections 2024-04-25T15:20:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7feb29ffb640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7feb2407c700 0x7feb2407eb50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f95a8df3640 1 -- 172.21.15.33:0/142836592 wait complete. 2024-04-25T15:20:48.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 shutdown_connections 2024-04-25T15:20:48.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 >> 172.21.15.33:0/33832899 conn(0x7fd7600063a0 msgr2=0x7fd760005bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 shutdown_connections 2024-04-25T15:20:48.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f616807c850 msgr2=0x7f616807eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f618db4d640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f616807c850 0x7f616807eca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7fd76ca30640 1 -- 172.21.15.33:0/33832899 wait complete. 2024-04-25T15:20:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6168074580 msgr2=0x7f6168076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f618db4d640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6168074580 0x7f6168076a90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6170034000 tx=0x7f617002c000 comp rx=0 tx=0).stop 2024-04-25T15:20:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 msgr2=0x7f6188132ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f618db4d640 1 --2- 172.21.15.33:0/538763886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6188149ec0 0x7f6188132ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6178007f20 tx=0x7f617800d560 comp rx=0 tx=0).stop 2024-04-25T15:20:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f6187fff640 1 -- 172.21.15.33:0/538763886 reap_dead start 2024-04-25T15:20:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7feb240744b0 msgr2=0x7feb240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7feb29ffb640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7feb240744b0 0x7feb240769c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb380c5ed0 tx=0x7feb2c0015e0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb38029ca0 msgr2=0x7feb38161710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7feb29ffb640 1 --2- 172.21.15.33:0/1739500589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb38029ca0 0x7feb38161710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb3400e840 tx=0x7feb3400ed00 comp rx=0 tx=0).stop 2024-04-25T15:20:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7feb3ffff640 1 -- 172.21.15.33:0/1739500589 reap_dead start 2024-04-25T15:20:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f1c6807c730 msgr2=0x7f1c6807eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.206+0000 7f1c8afb1640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f1c6807c730 0x7f1c6807eb80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f01dc07c850 msgr2=0x7f01dc07eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01f5ccd640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f01dc07c850 0x7f01dc07eca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f01dc074580 msgr2=0x7f01dc076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01f5ccd640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f01dc074580 0x7f01dc076a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f01e4034000 tx=0x7f01e402e000 comp rx=0 tx=0).stop 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f006d000 msgr2=0x7f01f0140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01f5ccd640 1 --2- 172.21.15.33:0/4170648744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01f006d000 0x7f01f0140210 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c5a0 tx=0x7f01e000ca60 comp rx=0 tx=0).stop 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1c680744e0 msgr2=0x7f1c680769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8afb1640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1c680744e0 0x7f1c680769f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007fd0 tx=0x7f1c80009040 comp rx=0 tx=0).stop 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 msgr2=0x7f1c840b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.284 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8afb1640 1 --2- 172.21.15.33:0/1709445020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c840b0890 0x7f1c840b3500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400e840 tx=0x7f1c7400ed00 comp rx=0 tx=0).stop 2024-04-25T15:20:48.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01effff640 1 -- 172.21.15.33:0/4170648744 reap_dead start 2024-04-25T15:20:48.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8a7b0640 1 -- 172.21.15.33:0/1709445020 reap_dead start 2024-04-25T15:20:48.285 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 shutdown_connections 2024-04-25T15:20:48.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 >> 172.21.15.33:0/4170648744 conn(0x7f01f006cbf0 msgr2=0x7f01f00b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 shutdown_connections 2024-04-25T15:20:48.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 >> 172.21.15.33:0/1739500589 conn(0x7feb38006270 msgr2=0x7feb38005780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.286 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 shutdown_connections 2024-04-25T15:20:48.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 >> 172.21.15.33:0/1709445020 conn(0x7f1c840ba640 msgr2=0x7f1c841436d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 shutdown_connections 2024-04-25T15:20:48.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 shutdown_connections 2024-04-25T15:20:48.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 >> 172.21.15.33:0/538763886 conn(0x7f618806f4c0 msgr2=0x7f6188062fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 shutdown_connections 2024-04-25T15:20:48.287 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7feb29ffb640 1 -- 172.21.15.33:0/1739500589 wait complete. 2024-04-25T15:20:48.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.207+0000 7f1c8afb1640 1 -- 172.21.15.33:0/1709445020 wait complete. 2024-04-25T15:20:48.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.208+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 shutdown_connections 2024-04-25T15:20:48.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.208+0000 7f01f5ccd640 1 -- 172.21.15.33:0/4170648744 wait complete. 2024-04-25T15:20:48.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.208+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 shutdown_connections 2024-04-25T15:20:48.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.208+0000 7f618db4d640 1 -- 172.21.15.33:0/538763886 wait complete. 2024-04-25T15:20:48.289 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-04-25T15:20:48.290 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:20:48.291 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2024-04-25T15:20:48.291 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:20:48.292 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-04-25T15:20:48.292 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:20:48.293 INFO:teuthology.orchestra.run.smithi033.stdout:55834574857 2024-04-25T15:20:48.293 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:20:48.294 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-04-25T15:20:48.294 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:20:48.295 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-04-25T15:20:48.296 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:20:48.296 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-04-25T15:20:48.297 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:20:48.298 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-04-25T15:20:48.298 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:20:48.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.546+0000 7f610b59e640 1 Processor -- start 2024-04-25T15:20:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.546+0000 7f610b59e640 1 -- start start 2024-04-25T15:20:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.547+0000 7f4a8de97640 1 Processor -- start 2024-04-25T15:20:48.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.547+0000 7f4a8de97640 1 -- start start 2024-04-25T15:20:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f610b59e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61040cb590 0x7f6104037290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f610b59e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61040d10a0 con 0x7f6104034900 2024-04-25T15:20:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f610b59e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610403a3d0 con 0x7f6104039a80 2024-04-25T15:20:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f883ec92640 1 Processor -- start 2024-04-25T15:20:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f610b59e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6104034d10 con 0x7f61040cb590 2024-04-25T15:20:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.547+0000 7f4d5ebce640 1 Processor -- start 2024-04-25T15:20:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.547+0000 7f4d5ebce640 1 -- start start 2024-04-25T15:20:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f610a59c640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6104039a80 0x7f61040cae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:49110/0 (socket says 172.21.15.33:49110) 2024-04-25T15:20:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f610a59c640 1 -- 172.21.15.33:0/1243760849 learned_addr learned my addr 172.21.15.33:0/1243760849 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f6109d9b640 1 --2- 172.21.15.33:0/1243760849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61040cb590 0x7f6104037290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.548+0000 7f883ec92640 1 -- start start 2024-04-25T15:20:48.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f610959a640 1 -- 172.21.15.33:0/1243760849 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266709592 0 0) 0x7f610403a3d0 con 0x7f6104039a80 2024-04-25T15:20:48.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f610959a640 1 -- 172.21.15.33:0/1243760849 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60f4003520 con 0x7f6104039a80 2024-04-25T15:20:48.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7efd9dc67640 1 Processor -- start 2024-04-25T15:20:48.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4d5ebce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d50037bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f610959a640 1 -- 172.21.15.33:0/1243760849 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284029545 0 0) 0x7f61040d10a0 con 0x7f6104034900 2024-04-25T15:20:48.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4a8de97640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4a800323c0 0x7f4a800cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f610959a640 1 -- 172.21.15.33:0/1243760849 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f610403a3d0 con 0x7f6104034900 2024-04-25T15:20:48.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f6109d9b640 1 -- 172.21.15.33:0/1243760849 >> v1:172.21.15.155:6789/0 conn(0x7f6104039a80 legacy=0x7f61040cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f6109d9b640 1 -- 172.21.15.33:0/1243760849 >> v1:172.21.15.33:6789/0 conn(0x7f6104034900 legacy=0x7f61040d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4a8de97640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4d5ebce640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d500c90a0 con 0x7f4d500d15a0 2024-04-25T15:20:48.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4d5ebce640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d500c9380 con 0x7f4d5000ae90 2024-04-25T15:20:48.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4a8de97640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a8001f7b0 con 0x7f4a800396b0 2024-04-25T15:20:48.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4d5ebce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4d500380f0 con 0x7f4d50039860 2024-04-25T15:20:48.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f6109d9b640 1 -- 172.21.15.33:0/1243760849 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6104037890 con 0x7f61040cb590 2024-04-25T15:20:48.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4a8de97640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8003a220 con 0x7f4a800323c0 2024-04-25T15:20:48.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4d5e3cd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4d500d15a0 0x7f4d500d39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45206/0 (socket says 172.21.15.33:45206) 2024-04-25T15:20:48.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4d5e3cd640 1 -- 172.21.15.33:0/1085322647 learned_addr learned my addr 172.21.15.33:0/1085322647 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:48.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4a8de97640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a80039bd0 con 0x7f4a800c3810 2024-04-25T15:20:48.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4a8d696640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4a8d696640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45542/0 (socket says 172.21.15.33:45542) 2024-04-25T15:20:48.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7f4a8d696640 1 -- 172.21.15.33:0/2744297465 learned_addr learned my addr 172.21.15.33:0/2744297465 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.550+0000 7f4d5dbcc640 1 --2- 172.21.15.33:0/1085322647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d50037bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.549+0000 7efd9dc67640 1 -- start start 2024-04-25T15:20:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.550+0000 7f4a8d696640 1 -- 172.21.15.33:0/2744297465 >> v2:172.21.15.33:3300/0 conn(0x7f4a800323c0 msgr2=0x7f4a800cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.550+0000 7f4a8ce95640 1 --2- 172.21.15.33:0/2744297465 >> v2:172.21.15.33:3300/0 conn(0x7f4a800323c0 0x7f4a800cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.550+0000 7f4a8d696640 1 --2- 172.21.15.33:0/2744297465 >> v2:172.21.15.33:3300/0 conn(0x7f4a800323c0 0x7f4a800cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.550+0000 7f4a8d696640 1 -- 172.21.15.33:0/2744297465 >> v1:172.21.15.155:6789/0 conn(0x7f4a800396b0 legacy=0x7f4a8003a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.550+0000 7f4a8d696640 1 -- 172.21.15.33:0/2744297465 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a80039eb0 con 0x7f4a800c3810 2024-04-25T15:20:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd9dc67640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efd981412d0 0x7efd981416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd9dc67640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd980b4fa0 con 0x7efd98071380 2024-04-25T15:20:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd9dc67640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd980b6420 con 0x7efd980b84c0 2024-04-25T15:20:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd9dc67640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7efd980b6a70 con 0x7efd981412d0 2024-04-25T15:20:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd977fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7efd980b84c0 0x7efd980b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:49142/0 (socket says 172.21.15.33:49142) 2024-04-25T15:20:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd977fe640 1 -- 172.21.15.33:0/3028334397 learned_addr learned my addr 172.21.15.33:0/3028334397 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:48.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f6109d9b640 1 --2- 172.21.15.33:0/1243760849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61040cb590 0x7f6104037290 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6104034e90 tx=0x7f610002a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad5cceb91a9f2b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd96ffd640 1 --2- 172.21.15.33:0/3028334397 >> v2:172.21.15.33:3300/0 conn(0x7efd981412d0 0x7efd981416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f883ec92640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f883809d940 0x7f883809dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f883ec92640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88380ba810 0x7f88380bac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f883ec92640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88380a13a0 con 0x7f883809c270 2024-04-25T15:20:48.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f883ec92640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f88380bb160 con 0x7f883809d940 2024-04-25T15:20:48.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f883ec92640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f883814a2b0 con 0x7f88380ba810 2024-04-25T15:20:48.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f4a8ce95640 1 --2- 172.21.15.33:0/2744297465 >> v2:172.21.15.33:3300/0 conn(0x7f4a800323c0 0x7f4a800cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:48.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f4d5dbcc640 1 -- 172.21.15.33:0/1085322647 >> v1:172.21.15.155:6789/0 conn(0x7f4d5000ae90 legacy=0x7f4d500c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f4d5cbca640 1 -- 172.21.15.33:0/1085322647 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511957615 0 0) 0x7f4d500c9380 con 0x7f4d5000ae90 2024-04-25T15:20:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f4d5dbcc640 1 -- 172.21.15.33:0/1085322647 >> v1:172.21.15.33:6789/0 conn(0x7f4d500d15a0 legacy=0x7f4d500d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f4d5dbcc640 1 -- 172.21.15.33:0/1085322647 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d500c9660 con 0x7f4d50039860 2024-04-25T15:20:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f610959a640 1 -- 172.21.15.33:0/1243760849 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100037070 con 0x7f61040cb590 2024-04-25T15:20:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f610959a640 1 -- 172.21.15.33:0/1243760849 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6100032440 con 0x7f61040cb590 2024-04-25T15:20:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f610959a640 1 -- 172.21.15.33:0/1243760849 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100032810 con 0x7f61040cb590 2024-04-25T15:20:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7f8837fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f883809d940 0x7f883809dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f8837fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f883809d940 0x7f883809dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51008/0 (socket says 172.21.15.33:51008) 2024-04-25T15:20:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f8837fff640 1 -- 172.21.15.33:0/414738951 learned_addr learned my addr 172.21.15.33:0/414738951 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f4d5dbcc640 1 --2- 172.21.15.33:0/1085322647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d50037bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4d480097d0 tx=0x7f4d48029f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b301a41415726e96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f8837fff640 1 -- 172.21.15.33:0/414738951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88380ba810 msgr2=0x7f88380bac20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:20:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f8837fff640 1 --2- 172.21.15.33:0/414738951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88380ba810 0x7f88380bac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f8837fff640 1 -- 172.21.15.33:0/414738951 >> v1:172.21.15.33:6789/0 conn(0x7f883809c270 legacy=0x7f8838149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f8837fff640 1 -- 172.21.15.33:0/414738951 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8838149f70 con 0x7f883809d940 2024-04-25T15:20:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd967fc640 1 -- 172.21.15.33:0/3028334397 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483909148 0 0) 0x7efd980b6420 con 0x7efd980b84c0 2024-04-25T15:20:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.551+0000 7efd967fc640 1 -- 172.21.15.33:0/3028334397 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd80003520 con 0x7efd980b84c0 2024-04-25T15:20:48.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f610b59e640 1 -- 172.21.15.33:0/1243760849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61040cb590 msgr2=0x7f6104037290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f610b59e640 1 --2- 172.21.15.33:0/1243760849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61040cb590 0x7f6104037290 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6104034e90 tx=0x7f610002a160 comp rx=0 tx=0).stop 2024-04-25T15:20:48.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f9d185c5640 1 Processor -- start 2024-04-25T15:20:48.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7f9d185c5640 1 -- start start 2024-04-25T15:20:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f4d5cbca640 1 -- 172.21.15.33:0/1085322647 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48037070 con 0x7f4d50039860 2024-04-25T15:20:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7efd96ffd640 1 -- 172.21.15.33:0/3028334397 >> v1:172.21.15.155:6789/0 conn(0x7efd980b84c0 legacy=0x7efd980b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7efd96ffd640 1 -- 172.21.15.33:0/3028334397 >> v1:172.21.15.33:6789/0 conn(0x7efd98071380 legacy=0x7efd98151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.552+0000 7efd96ffd640 1 -- 172.21.15.33:0/3028334397 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd980b6700 con 0x7efd981412d0 2024-04-25T15:20:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f4a8d696640 1 --2- 172.21.15.33:0/2744297465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c3c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a880769e0 tx=0x7f4a880a9670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d016a0c13ad0a0b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f4d5cbca640 1 -- 172.21.15.33:0/1085322647 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4802abd0 con 0x7f4d50039860 2024-04-25T15:20:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f4d5cbca640 1 -- 172.21.15.33:0/1085322647 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48032440 con 0x7f4d50039860 2024-04-25T15:20:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f4a877fe640 1 -- 172.21.15.33:0/2744297465 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a880b0600 con 0x7f4a800c3810 2024-04-25T15:20:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f4a877fe640 1 -- 172.21.15.33:0/2744297465 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a880a9e50 con 0x7f4a800c3810 2024-04-25T15:20:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f4a877fe640 1 -- 172.21.15.33:0/2744297465 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a880b0a60 con 0x7f4a800c3810 2024-04-25T15:20:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f71fca4d640 1 Processor -- start 2024-04-25T15:20:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f71fca4d640 1 -- start start 2024-04-25T15:20:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7efd96ffd640 1 --2- 172.21.15.33:0/3028334397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd981412d0 0x7efd981416e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd900097a0 tx=0x7efd9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9459d7f8ddda21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7efd967fc640 1 -- 172.21.15.33:0/3028334397 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90037070 con 0x7efd981412d0 2024-04-25T15:20:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f610b59e640 1 -- 172.21.15.33:0/1243760849 shutdown_connections 2024-04-25T15:20:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f610b59e640 1 --2- 172.21.15.33:0/1243760849 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61040cb590 0x7f6104037290 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f610b59e640 1 -- 172.21.15.33:0/1243760849 >> 172.21.15.33:0/1243760849 conn(0x7f6104006270 msgr2=0x7f6104006680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f610b59e640 1 -- 172.21.15.33:0/1243760849 shutdown_connections 2024-04-25T15:20:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.553+0000 7f610b59e640 1 -- 172.21.15.33:0/1243760849 wait complete. 2024-04-25T15:20:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7efd967fc640 1 -- 172.21.15.33:0/3028334397 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90032440 con 0x7efd981412d0 2024-04-25T15:20:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7efd967fc640 1 -- 172.21.15.33:0/3028334397 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90032810 con 0x7efd981412d0 2024-04-25T15:20:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f9d185c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d100b5680 0x7f9d10146610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f4d5ebce640 1 -- 172.21.15.33:0/1085322647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 msgr2=0x7f4d50037bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f4d5ebce640 1 --2- 172.21.15.33:0/1085322647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d50037bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4d480097d0 tx=0x7f4d48029f40 comp rx=0 tx=0).stop 2024-04-25T15:20:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f309e496640 1 Processor -- start 2024-04-25T15:20:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f9d185c5640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d10146b50 0x7f9d101402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f4a8de97640 1 -- 172.21.15.33:0/2744297465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 msgr2=0x7f4a800c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f4a8de97640 1 --2- 172.21.15.33:0/2744297465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c3c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4a880769e0 tx=0x7f4a880a9670 comp rx=0 tx=0).stop 2024-04-25T15:20:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f8837fff640 1 --2- 172.21.15.33:0/414738951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f883809dd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8838149550 tx=0x7f882402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4189db40fd0ced9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4a8de97640 1 -- 172.21.15.33:0/2744297465 shutdown_connections 2024-04-25T15:20:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4a8de97640 1 --2- 172.21.15.33:0/2744297465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c3c20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f9d16361640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d100b5680 0x7f9d10146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4a8de97640 1 --2- 172.21.15.33:0/2744297465 >> v2:172.21.15.33:3300/0 conn(0x7f4a800323c0 0x7f4a800cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4a8de97640 1 -- 172.21.15.33:0/2744297465 >> 172.21.15.33:0/2744297465 conn(0x7f4a8003b7b0 msgr2=0x7f4a8003bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f9d16361640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d100b5680 0x7f9d10146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51022/0 (socket says 172.21.15.33:51022) 2024-04-25T15:20:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f88377fe640 1 -- 172.21.15.33:0/414738951 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824037070 con 0x7f883809d940 2024-04-25T15:20:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f88377fe640 1 -- 172.21.15.33:0/414738951 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8824032440 con 0x7f883809d940 2024-04-25T15:20:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f88377fe640 1 -- 172.21.15.33:0/414738951 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824032810 con 0x7f883809d940 2024-04-25T15:20:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7efd9dc67640 1 -- 172.21.15.33:0/3028334397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd981412d0 msgr2=0x7efd981416e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7efd9dc67640 1 --2- 172.21.15.33:0/3028334397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd981412d0 0x7efd981416e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efd900097a0 tx=0x7efd9002a1e0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f9d16361640 1 -- 172.21.15.33:0/4215755906 learned_addr learned my addr 172.21.15.33:0/4215755906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f9d15b60640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9d10146b50 0x7f9d101402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4a8de97640 1 -- 172.21.15.33:0/2744297465 shutdown_connections 2024-04-25T15:20:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4a8de97640 1 -- 172.21.15.33:0/2744297465 wait complete. 2024-04-25T15:20:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7efd9dc67640 1 -- 172.21.15.33:0/3028334397 shutdown_connections 2024-04-25T15:20:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7efd9dc67640 1 --2- 172.21.15.33:0/3028334397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd981412d0 0x7efd981416e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7efd9dc67640 1 -- 172.21.15.33:0/3028334397 >> 172.21.15.33:0/3028334397 conn(0x7efd980b93d0 msgr2=0x7efd980b97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4d5ebce640 1 -- 172.21.15.33:0/1085322647 shutdown_connections 2024-04-25T15:20:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4d5ebce640 1 --2- 172.21.15.33:0/1085322647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d50037bb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f4d5ebce640 1 -- 172.21.15.33:0/1085322647 >> 172.21.15.33:0/1085322647 conn(0x7f4d50006270 msgr2=0x7f4d50006680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7efd9dc67640 1 -- 172.21.15.33:0/3028334397 shutdown_connections 2024-04-25T15:20:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f71fca4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71f00397a0 0x7f71f00c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f71fca4d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f002a130 con 0x7f71f00c9bf0 2024-04-25T15:20:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f71fca4d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f002a410 con 0x7f71f00d22e0 2024-04-25T15:20:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f71fca4d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71f0034cf0 con 0x7f71f00397a0 2024-04-25T15:20:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f6ffd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f71f00c9bf0 0x7f71f00ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45240/0 (socket says 172.21.15.33:45240) 2024-04-25T15:20:48.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7f9d185c5640 1 --2- 172.21.15.33:0/4215755906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d10149a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f6ffd640 1 -- 172.21.15.33:0/1892169448 learned_addr learned my addr 172.21.15.33:0/1892169448 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:48.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.555+0000 7efd9dc67640 1 -- 172.21.15.33:0/3028334397 wait complete. 2024-04-25T15:20:48.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f883ec92640 1 -- 172.21.15.33:0/414738951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 msgr2=0x7f883809dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f883ec92640 1 --2- 172.21.15.33:0/414738951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f883809dd50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8838149550 tx=0x7f882402a180 comp rx=0 tx=0).stop 2024-04-25T15:20:48.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370197362 0 0) 0x7f71f002a410 con 0x7f71f00d22e0 2024-04-25T15:20:48.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e8003520 con 0x7f71f00d22e0 2024-04-25T15:20:48.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f610b59e640 1 Processor -- start 2024-04-25T15:20:48.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485259126 0 0) 0x7f71f002a130 con 0x7f71f00c9bf0 2024-04-25T15:20:48.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71f002a410 con 0x7f71f00c9bf0 2024-04-25T15:20:48.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f9d185c5640 1 -- 172.21.15.33:0/4215755906 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f9d10073aa0 con 0x7f9d10146b50 2024-04-25T15:20:48.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f9d185c5640 1 -- 172.21.15.33:0/4215755906 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9d100b5a90 con 0x7f9d100b5680 2024-04-25T15:20:48.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f610b59e640 1 -- start start 2024-04-25T15:20:48.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71f00397a0 0x7f71f00c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3404305149 0 0) 0x7f71e8003520 con 0x7f71f00d22e0 2024-04-25T15:20:48.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.554+0000 7f309e496640 1 -- start start 2024-04-25T15:20:48.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f309e496640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098150fb0 0x7f3098147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71f00397a0 msgr2=0x7f71f00c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71f00397a0 0x7f71f00c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 >> v1:172.21.15.33:6789/0 conn(0x7f71f00c9bf0 legacy=0x7f71f00ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f883ec92640 1 -- 172.21.15.33:0/414738951 shutdown_connections 2024-04-25T15:20:48.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f309e496640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3098151e60 con 0x7f3098072690 2024-04-25T15:20:48.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f309e496640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3098071730 con 0x7f3098071f80 2024-04-25T15:20:48.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0039bb0 con 0x7f71f00d22e0 2024-04-25T15:20:48.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7f71f8076c00 con 0x7f71f00d22e0 2024-04-25T15:20:48.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 >> v1:172.21.15.155:6789/0 conn(0x7f71f00d22e0 legacy=0x7f71f00d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71e8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8004800 0x7f71e8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71e8005270 0x7f71e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f71f0034cf0 con 0x7f71e8004800 2024-04-25T15:20:48.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71e800c190 con 0x7f71e8005270 2024-04-25T15:20:48.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71e800c390 con 0x7f71e8003b40 2024-04-25T15:20:48.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71f00397a0 0x7f71f00c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:48.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f309ca33640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f3098071f80 0x7f3098158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:49156/0 (socket says 172.21.15.33:49156) 2024-04-25T15:20:48.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f309ca33640 1 -- 172.21.15.33:0/767839083 learned_addr learned my addr 172.21.15.33:0/767839083 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:48.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f309e496640 1 -- 172.21.15.33:0/767839083 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3098071af0 con 0x7f3098150fb0 2024-04-25T15:20:48.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f6ffd640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8004800 0x7f71e8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71e8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f9d185c5640 1 -- 172.21.15.33:0/4215755906 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d100b1a80 con 0x7f9d10140810 2024-04-25T15:20:48.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f9d16b62640 1 --2- 172.21.15.33:0/4215755906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d10149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f7fff640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71e8005270 0x7f71e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757620724 0 0) 0x7f3098071730 con 0x7f3098071f80 2024-04-25T15:20:48.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3088003520 con 0x7f3098071f80 2024-04-25T15:20:48.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f883ec92640 1 --2- 172.21.15.33:0/414738951 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88380ba810 0x7f88380bac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f883ec92640 1 --2- 172.21.15.33:0/414738951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f883809dd50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.556+0000 7f883ec92640 1 -- 172.21.15.33:0/414738951 >> 172.21.15.33:0/414738951 conn(0x7f88380bb460 msgr2=0x7f88380bb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f4a8de97640 1 Processor -- start 2024-04-25T15:20:48.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f4a8de97640 1 -- start start 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3015313096 0 0) 0x7f3088003520 con 0x7f3098071f80 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098150fb0 msgr2=0x7f3098147dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098150fb0 0x7f3098147dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 >> v1:172.21.15.33:6789/0 conn(0x7f3098072690 legacy=0x7f30980b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30980b17e0 con 0x7f3098071f80 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7f3090001a20 con 0x7f3098071f80 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 >> v1:172.21.15.155:6789/0 conn(0x7f3098071f80 legacy=0x7f3098158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f3096ffd640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30880039b0 0x7f3088003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3096ffd640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3088004800 0x7f3088004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3096ffd640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3088005350 0x7f308800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3098071af0 con 0x7f3088004800 2024-04-25T15:20:48.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f308800c250 con 0x7f3088005350 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f308800c450 con 0x7f30880039b0 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3097fff640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30880039b0 0x7f3088003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f309ca33640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3088005350 0x7f308800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f30977fe640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3088004800 0x7f3088004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3097fff640 1 -- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3088005350 msgr2=0x7f308800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3097fff640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3088005350 0x7f308800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3097fff640 1 -- 172.21.15.33:0/767839083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3088004800 msgr2=0x7f3088004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3097fff640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3088004800 0x7f3088004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f3097fff640 1 -- 172.21.15.33:0/767839083 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3088003520 con 0x7f30880039b0 2024-04-25T15:20:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f30977fe640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3088004800 0x7f3088004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f77fe640 1 -- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71e8005270 msgr2=0x7f71e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71e8005270 0x7f71e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f77fe640 1 -- 172.21.15.33:0/1892169448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8004800 msgr2=0x7f71e8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8004800 0x7f71e8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f77fe640 1 -- 172.21.15.33:0/1892169448 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0039bb0 con 0x7f71e8003b40 2024-04-25T15:20:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f71f6ffd640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71e8004800 0x7f71e8004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7efd9dc67640 1 Processor -- start 2024-04-25T15:20:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7efd9dc67640 1 -- start start 2024-04-25T15:20:48.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f610b59e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6104034900 0x7f61040d0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f610b59e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6104039a80 0x7f610416a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f9d16b62640 1 -- 172.21.15.33:0/4215755906 >> v2:172.21.15.155:3300/0 conn(0x7f9d100b5680 msgr2=0x7f9d10146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f9d16b62640 1 --2- 172.21.15.33:0/4215755906 >> v2:172.21.15.155:3300/0 conn(0x7f9d100b5680 0x7f9d10146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f9d16b62640 1 -- 172.21.15.33:0/4215755906 >> v2:172.21.15.33:3300/0 conn(0x7f9d10146b50 msgr2=0x7f9d101402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:48.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f9d16b62640 1 --2- 172.21.15.33:0/4215755906 >> v2:172.21.15.33:3300/0 conn(0x7f9d10146b50 0x7f9d101402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.557+0000 7f9d16b62640 1 -- 172.21.15.33:0/4215755906 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d10073cf0 con 0x7f9d10140810 2024-04-25T15:20:48.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f9d16361640 1 --2- 172.21.15.33:0/4215755906 >> v2:172.21.15.155:3300/0 conn(0x7f9d100b5680 0x7f9d10146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:48.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f9d15b60640 1 --2- 172.21.15.33:0/4215755906 >> v2:172.21.15.33:3300/0 conn(0x7f9d10146b50 0x7f9d101402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:48.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f883ec92640 1 -- 172.21.15.33:0/414738951 shutdown_connections 2024-04-25T15:20:48.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f883ec92640 1 -- 172.21.15.33:0/414738951 wait complete. 2024-04-25T15:20:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f610a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6104034900 0x7f61040d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f610a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6104034900 0x7f61040d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51058/0 (socket says 172.21.15.33:51058) 2024-04-25T15:20:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.558+0000 7f610a59c640 1 -- 172.21.15.33:0/3287802685 learned_addr learned my addr 172.21.15.33:0/3287802685 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f6109d9b640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6104039a80 0x7f610416a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610b59e640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61040cb590 0x7f61040bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71e8003f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71f000b9d0 tx=0x7f71e8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb1976201d0ac3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f61040d1e30 con 0x7f61040cb590 2024-04-25T15:20:48.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4037070 con 0x7f71e8003b40 2024-04-25T15:20:48.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610ad9d640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61040cb590 0x7f61040bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.597 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61040d1cb0 con 0x7f6104034900 2024-04-25T15:20:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f4d5ebce640 1 -- 172.21.15.33:0/1085322647 shutdown_connections 2024-04-25T15:20:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f610416ad20 con 0x7f6104039a80 2024-04-25T15:20:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e402aa50 con 0x7f71e8003b40 2024-04-25T15:20:48.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f71f67fc640 1 -- 172.21.15.33:0/1892169448 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e400a4d0 con 0x7f71e8003b40 2024-04-25T15:20:48.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f9d16b62640 1 --2- 172.21.15.33:0/4215755906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d10149a80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d1006d4d0 tx=0x7f9d0802e9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d093f11fff2a79b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610ad9d640 1 -- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6104039a80 msgr2=0x7f610416a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610ad9d640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6104039a80 0x7f610416a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610ad9d640 1 -- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6104034900 msgr2=0x7f61040d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610ad9d640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6104034900 0x7f61040d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f610ad9d640 1 -- 172.21.15.33:0/3287802685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6104036c70 con 0x7f61040cb590 2024-04-25T15:20:48.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f9d1535f640 1 -- 172.21.15.33:0/4215755906 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08037070 con 0x7f9d10140810 2024-04-25T15:20:48.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f9d1535f640 1 -- 172.21.15.33:0/4215755906 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d08033850 con 0x7f9d10140810 2024-04-25T15:20:48.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f9d1535f640 1 -- 172.21.15.33:0/4215755906 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08033c20 con 0x7f9d10140810 2024-04-25T15:20:48.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f610ad9d640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61040cb590 0x7f61040bc5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f610c06b670 tx=0x7f610c06eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f71fca4d640 1 -- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 msgr2=0x7f71e8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f71fca4d640 1 --2- 172.21.15.33:0/1892169448 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71e8003f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f71f000b9d0 tx=0x7f71e8005830 comp rx=0 tx=0).stop 2024-04-25T15:20:48.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f71f7fff640 1 -- 172.21.15.33:0/1892169448 reap_dead start 2024-04-25T15:20:48.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f71fca4d640 1 -- 172.21.15.33:0/1892169448 shutdown_connections 2024-04-25T15:20:48.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f71fca4d640 1 -- 172.21.15.33:0/1892169448 >> 172.21.15.33:0/1892169448 conn(0x7f71f0006270 msgr2=0x7f71f0006680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7efd9dc67640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd98071380 0x7efd980ba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f60faffd640 1 -- 172.21.15.33:0/3287802685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c06ec50 con 0x7f61040cb590 2024-04-25T15:20:48.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f60faffd640 1 -- 172.21.15.33:0/3287802685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c06edf0 con 0x7f61040cb590 2024-04-25T15:20:48.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f71fca4d640 1 -- 172.21.15.33:0/1892169448 shutdown_connections 2024-04-25T15:20:48.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f60faffd640 1 -- 172.21.15.33:0/3287802685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c0748e0 con 0x7f61040cb590 2024-04-25T15:20:48.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61040ccf80 con 0x7f61040cb590 2024-04-25T15:20:48.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f4a8de97640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800323c0 0x7f4a800c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7efd9dc67640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd980b84c0 0x7efd98145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7efd9dc67640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981412d0 0x7efd98134970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7efd9dc67640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efd980b6130 con 0x7efd98071380 2024-04-25T15:20:48.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610416a800 con 0x7f61040cb590 2024-04-25T15:20:48.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f4a8de97640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a800396b0 0x7f4a8015e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7efd977fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd98071380 0x7efd980ba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd9dc67640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd980b5fb0 con 0x7efd981412d0 2024-04-25T15:20:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd9dc67640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efd98071790 con 0x7efd980b84c0 2024-04-25T15:20:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7efd977fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd98071380 0x7efd980ba8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51242/0 (socket says 172.21.15.33:51242) 2024-04-25T15:20:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd977fe640 1 -- 172.21.15.33:0/3730319492 learned_addr learned my addr 172.21.15.33:0/3730319492 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.560+0000 7f71fca4d640 1 -- 172.21.15.33:0/1892169448 wait complete. 2024-04-25T15:20:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd97fff640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981412d0 0x7efd98134970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd96ffd640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd980b84c0 0x7efd98145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f9d185c5640 1 -- 172.21.15.33:0/4215755906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 msgr2=0x7f9d10149a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f9d185c5640 1 --2- 172.21.15.33:0/4215755906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d10149a80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d1006d4d0 tx=0x7f9d0802e9f0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.559+0000 7f4d5ebce640 1 -- 172.21.15.33:0/1085322647 wait complete. 2024-04-25T15:20:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd977fe640 1 -- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd980b84c0 msgr2=0x7efd98145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd977fe640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd980b84c0 0x7efd98145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd977fe640 1 -- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981412d0 msgr2=0x7efd98134970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd977fe640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981412d0 0x7efd98134970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd977fe640 1 -- 172.21.15.33:0/3730319492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd980badf0 con 0x7efd98071380 2024-04-25T15:20:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f9d185c5640 1 -- 172.21.15.33:0/4215755906 shutdown_connections 2024-04-25T15:20:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f883ec92640 1 Processor -- start 2024-04-25T15:20:48.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7efd977fe640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd98071380 0x7efd980ba8b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd8800caa0 tx=0x7efd8800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f4d5ebce640 1 Processor -- start 2024-04-25T15:20:48.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f883ec92640 1 -- start start 2024-04-25T15:20:48.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f9d185c5640 1 --2- 172.21.15.33:0/4215755906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d10149a80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f9d185c5640 1 --2- 172.21.15.33:0/4215755906 >> v2:172.21.15.33:3300/0 conn(0x7f9d10146b50 0x7f9d101402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f4d5ebce640 1 -- start start 2024-04-25T15:20:48.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f9d185c5640 1 --2- 172.21.15.33:0/4215755906 >> v2:172.21.15.155:3300/0 conn(0x7f9d100b5680 0x7f9d10146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7efd7ffff640 1 -- 172.21.15.33:0/3730319492 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88017070 con 0x7efd98071380 2024-04-25T15:20:48.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f9d185c5640 1 -- 172.21.15.33:0/4215755906 >> 172.21.15.33:0/4215755906 conn(0x7f9d1006ce70 msgr2=0x7f9d100ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.610 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7efd7ffff640 1 -- 172.21.15.33:0/3730319492 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8800abc0 con 0x7efd98071380 2024-04-25T15:20:48.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f4a8ce95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800323c0 0x7f4a800c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.561+0000 7f4a8ce95640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800323c0 0x7f4a800c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51254/0 (socket says 172.21.15.33:51254) 2024-04-25T15:20:48.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f4a8de97640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f4a8de97640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4a800c42e0 con 0x7f4a800323c0 2024-04-25T15:20:48.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f4a8de97640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a800c4160 con 0x7f4a800396b0 2024-04-25T15:20:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f4a8de97640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a80021600 con 0x7f4a800c3810 2024-04-25T15:20:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd98146240 con 0x7efd98071380 2024-04-25T15:20:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd980bb060 con 0x7efd98071380 2024-04-25T15:20:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7efd7ffff640 1 -- 172.21.15.33:0/3730319492 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88012400 con 0x7efd98071380 2024-04-25T15:20:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f71fca4d640 1 Processor -- start 2024-04-25T15:20:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f71fca4d640 1 -- start start 2024-04-25T15:20:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5ebce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d5000ae90 0x7f4d500c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f4a8ce95640 1 -- 172.21.15.33:0/1994323782 learned_addr learned my addr 172.21.15.33:0/1994323782 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.562+0000 7f4a87fff640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a800396b0 0x7f4a8015e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f4a8d696640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f4a8ce95640 1 -- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 msgr2=0x7f4a800c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f4a8ce95640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f60faffd640 1 -- 172.21.15.33:0/3287802685 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f610c096440 con 0x7f61040cb590 2024-04-25T15:20:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f4a8ce95640 1 -- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a800396b0 msgr2=0x7f4a8015e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f4a8ce95640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a800396b0 0x7f4a8015e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f4a8ce95640 1 -- 172.21.15.33:0/1994323782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8015eca0 con 0x7f4a800323c0 2024-04-25T15:20:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.563+0000 7f4a8ce95640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800323c0 0x7f4a800c9580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00aa80 tx=0x7f4a7c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883ec92640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883809c270 0x7f88381dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883ec92640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f88380b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4a857fa640 1 -- 172.21.15.33:0/1994323782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c007a00 con 0x7f4a800323c0 2024-04-25T15:20:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5ebce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d500c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5ebce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d500d15a0 0x7f4d500cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5ebce640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500c3260 con 0x7f4d500d15a0 2024-04-25T15:20:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5ebce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4d500c9b80 con 0x7f4d5000ae90 2024-04-25T15:20:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5ebce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4d500c33e0 con 0x7f4d50039860 2024-04-25T15:20:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883ec92640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88380ba810 0x7f883814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f3097fff640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30880039b0 0x7f3088003e20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f30980b4620 tx=0x7f3088005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=210b622fe089556c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f8837fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f88380b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883ca2e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883809c270 0x7f88381dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f8837fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f88380b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51096/0 (socket says 172.21.15.33:51096) 2024-04-25T15:20:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883ca2e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883809c270 0x7f88381dfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45618/0 (socket says 172.21.15.33:45618) 2024-04-25T15:20:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5d3cb640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d500c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5e3cd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d500d15a0 0x7f4d500cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5e3cd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d500d15a0 0x7f4d500cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51272/0 (socket says 172.21.15.33:51272) 2024-04-25T15:20:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4d5e3cd640 1 -- 172.21.15.33:0/3374885257 learned_addr learned my addr 172.21.15.33:0/3374885257 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c001370 con 0x7f30880039b0 2024-04-25T15:20:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308c0052d0 con 0x7f30880039b0 2024-04-25T15:20:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f3096ffd640 1 -- 172.21.15.33:0/767839083 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c02aba0 con 0x7f30880039b0 2024-04-25T15:20:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883d22f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88380ba810 0x7f883814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883d22f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88380ba810 0x7f883814cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51260/0 (socket says 172.21.15.33:51260) 2024-04-25T15:20:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883ec92640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8838154240 con 0x7f88380ba810 2024-04-25T15:20:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883ec92640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f88381540c0 con 0x7f883809d940 2024-04-25T15:20:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f883ec92640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f88381543c0 con 0x7f883809c270 2024-04-25T15:20:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd78005290 con 0x7efd98071380 2024-04-25T15:20:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71fca4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71f00d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f9d185c5640 1 -- 172.21.15.33:0/4215755906 shutdown_connections 2024-04-25T15:20:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f4d5dbcc640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d5000ae90 0x7f4d500c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f8837fff640 1 -- 172.21.15.33:0/1877579132 learned_addr learned my addr 172.21.15.33:0/1877579132 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71fca4d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f00cbe10 0x7f71f00aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f60faffd640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f60ec0745b0 0x7f60ec076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f60faffd640 1 -- 172.21.15.33:0/3287802685 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f610c1115a0 con 0x7f61040cb590 2024-04-25T15:20:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f0005290 con 0x7f61040cb590 2024-04-25T15:20:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71fca4d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71f00af190 0x7f71f0166210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a80155bb0 con 0x7f4a800323c0 2024-04-25T15:20:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.564+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a800c81b0 con 0x7f4a800323c0 2024-04-25T15:20:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f4a857fa640 1 -- 172.21.15.33:0/1994323782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7c007ba0 con 0x7f4a800323c0 2024-04-25T15:20:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f4a857fa640 1 -- 172.21.15.33:0/1994323782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c018380 con 0x7f4a800323c0 2024-04-25T15:20:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f610a59c640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f60ec0745b0 0x7f60ec076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f8837fff640 1 -- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883809c270 msgr2=0x7f88381dfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f8837fff640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883809c270 0x7f88381dfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f8837fff640 1 -- 172.21.15.33:0/1877579132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88380ba810 msgr2=0x7f883814cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71f7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71f00af190 0x7f71f0166210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71f7fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71f00af190 0x7f71f0166210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51286/0 (socket says 172.21.15.33:51286) 2024-04-25T15:20:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71f6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f00cbe10 0x7f71f00aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71f6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f00cbe10 0x7f71f00aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51106/0 (socket says 172.21.15.33:51106) 2024-04-25T15:20:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71f77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71f00d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71f77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71f00d8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45642/0 (socket says 172.21.15.33:45642) 2024-04-25T15:20:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71f7fff640 1 -- 172.21.15.33:0/1430717115 learned_addr learned my addr 172.21.15.33:0/1430717115 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f8837fff640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88380ba810 0x7f883814cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f8837fff640 1 -- 172.21.15.33:0/1877579132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88381e0400 con 0x7f883809d940 2024-04-25T15:20:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f883d22f640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88380ba810 0x7f883814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7efd7ffff640 1 -- 172.21.15.33:0/3730319492 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efd8801a070 con 0x7efd98071380 2024-04-25T15:20:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f71f002a780 con 0x7f71f00af190 2024-04-25T15:20:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.565+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71f00343e0 con 0x7f71f00cbe10 2024-04-25T15:20:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71f0037a40 con 0x7f71e8003b40 2024-04-25T15:20:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f8837fff640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f88380b49b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8824009960 tx=0x7f88240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f88357fa640 1 -- 172.21.15.33:0/1877579132 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824041070 con 0x7f883809d940 2024-04-25T15:20:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f610a59c640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f60ec0745b0 0x7f60ec076ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60fc000f60 tx=0x7f60fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f88357fa640 1 -- 172.21.15.33:0/1877579132 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882403c870 con 0x7f883809d940 2024-04-25T15:20:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f88357fa640 1 -- 172.21.15.33:0/1877579132 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8824037040 con 0x7f883809d940 2024-04-25T15:20:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883813d870 con 0x7f883809d940 2024-04-25T15:20:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f309e496640 1 -- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30880039b0 msgr2=0x7f3088003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f309e496640 1 --2- 172.21.15.33:0/767839083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30880039b0 0x7f3088003e20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f30980b4620 tx=0x7f3088005830 comp rx=0 tx=0).stop 2024-04-25T15:20:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f309ca33640 1 -- 172.21.15.33:0/767839083 reap_dead start 2024-04-25T15:20:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88381e3cb0 con 0x7f883809d940 2024-04-25T15:20:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f309e496640 1 -- 172.21.15.33:0/767839083 shutdown_connections 2024-04-25T15:20:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7efd7ffff640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efd840745b0 0x7efd84076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f309e496640 1 -- 172.21.15.33:0/767839083 >> 172.21.15.33:0/767839083 conn(0x7f309806cfe0 msgr2=0x7f30980b7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f71f7fff640 1 -- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 msgr2=0x7f71f00d8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f71f7fff640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71f00d8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7efd7ffff640 1 -- 172.21.15.33:0/3730319492 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd88094eb0 con 0x7efd98071380 2024-04-25T15:20:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f71f7fff640 1 -- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f00cbe10 msgr2=0x7f71f00aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f71f7fff640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f00cbe10 0x7f71f00aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f71f7fff640 1 -- 172.21.15.33:0/1430717115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f00ccb50 con 0x7f71f00af190 2024-04-25T15:20:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f71f6ffd640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f00cbe10 0x7f71f00aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.567+0000 7f309e496640 1 -- 172.21.15.33:0/767839083 shutdown_connections 2024-04-25T15:20:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71f00d8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.567+0000 7f71f7fff640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71f00af190 0x7f71f0166210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71f8066010 tx=0x7f71f806ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.567+0000 7f309e496640 1 -- 172.21.15.33:0/767839083 wait complete. 2024-04-25T15:20:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f4d5d3cb640 1 -- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d5000ae90 msgr2=0x7f4d500c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f4d5d3cb640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d5000ae90 0x7f4d500c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f4d5d3cb640 1 -- 172.21.15.33:0/3374885257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d500d15a0 msgr2=0x7f4d500cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f4d5d3cb640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d500d15a0 0x7f4d500cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.566+0000 7f4d5d3cb640 1 -- 172.21.15.33:0/3374885257 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d500ca740 con 0x7f4d50039860 2024-04-25T15:20:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.567+0000 7efd96ffd640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efd840745b0 0x7efd84076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.567+0000 7f9d185c5640 1 -- 172.21.15.33:0/4215755906 wait complete. 2024-04-25T15:20:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a68005290 con 0x7f4a800323c0 2024-04-25T15:20:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f4d5d3cb640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d500c17c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000beb0 tx=0x7f4d5400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8818005290 con 0x7f883809d940 2024-04-25T15:20:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f4d4e7fc640 1 -- 172.21.15.33:0/3374885257 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54017070 con 0x7f4d50039860 2024-04-25T15:20:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7efd96ffd640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efd840745b0 0x7efd84076ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd90034000 tx=0x7efd9002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f4d4e7fc640 1 -- 172.21.15.33:0/3374885257 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d540035f0 con 0x7f4d50039860 2024-04-25T15:20:48.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f4d4e7fc640 1 -- 172.21.15.33:0/3374885257 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d540039e0 con 0x7f4d50039860 2024-04-25T15:20:48.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d500c9df0 con 0x7f4d50039860 2024-04-25T15:20:48.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d500c48d0 con 0x7f4d50039860 2024-04-25T15:20:48.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.568+0000 7f88357fa640 1 -- 172.21.15.33:0/1877579132 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8824044070 con 0x7f883809d940 2024-04-25T15:20:48.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.569+0000 7f88357fa640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f881c0744e0 0x7f881c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.569+0000 7f88357fa640 1 -- 172.21.15.33:0/1877579132 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f88240b5c80 con 0x7f883809d940 2024-04-25T15:20:48.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.569+0000 7f883ca2e640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f881c0744e0 0x7f881c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.569+0000 7f309e496640 1 Processor -- start 2024-04-25T15:20:48.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.569+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d50005570 con 0x7f4d50039860 2024-04-25T15:20:48.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.570+0000 7f883ca2e640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f881c0744e0 0x7f881c0769f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f883809eb00 tx=0x7f883000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.570+0000 7f309e496640 1 -- start start 2024-04-25T15:20:48.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.570+0000 7f4d4e7fc640 1 -- 172.21.15.33:0/3374885257 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4d5401a070 con 0x7f4d50039860 2024-04-25T15:20:48.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.570+0000 7f9d185c5640 1 Processor -- start 2024-04-25T15:20:48.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.570+0000 7f4d4e7fc640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4d3c0744b0 0x7f4d3c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.570+0000 7f9d185c5640 1 -- start start 2024-04-25T15:20:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.571+0000 7f4d5dbcc640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4d3c0744b0 0x7f4d3c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.571+0000 7f4d4e7fc640 1 -- 172.21.15.33:0/3374885257 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4d5405abc0 con 0x7f4d50039860 2024-04-25T15:20:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.571+0000 7f4d5dbcc640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4d3c0744b0 0x7f4d3c0769c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d48034000 tx=0x7f4d4802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.571+0000 7f309e496640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30880039b0 0x7f309814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.571+0000 7f309e496640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098142ef0 0x7f3098143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.571+0000 7f309e496640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980b19e0 0x7f30980b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f309e496640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3098072390 con 0x7f30980b19e0 2024-04-25T15:20:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f309e496640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3098072e20 con 0x7f30880039b0 2024-04-25T15:20:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f309e496640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30980b6c80 con 0x7f3098142ef0 2024-04-25T15:20:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f30977fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098142ef0 0x7f3098143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f30977fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098142ef0 0x7f3098143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45658/0 (socket says 172.21.15.33:45658) 2024-04-25T15:20:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f30977fe640 1 -- 172.21.15.33:0/269894358 learned_addr learned my addr 172.21.15.33:0/269894358 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d185c5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d100b5680 0x7f9d101cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f309ca33640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980b19e0 0x7f30980b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d185c5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d101de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d185c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d10146b50 0x7f9d1013b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d185c5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9d100731e0 con 0x7f9d100b5680 2024-04-25T15:20:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d185c5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10140c20 con 0x7f9d10146b50 2024-04-25T15:20:48.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d185c5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d100b1750 con 0x7f9d10140810 2024-04-25T15:20:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d16361640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d100b5680 0x7f9d101cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d16361640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d100b5680 0x7f9d101cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51302/0 (socket says 172.21.15.33:51302) 2024-04-25T15:20:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d16361640 1 -- 172.21.15.33:0/2919518966 learned_addr learned my addr 172.21.15.33:0/2919518966 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f3097fff640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30880039b0 0x7f309814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d16b62640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d10146b50 0x7f9d1013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.643 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f9d15b60640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d101de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f30977fe640 1 -- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30880039b0 msgr2=0x7f309814fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f30977fe640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30880039b0 0x7f309814fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f30977fe640 1 -- 172.21.15.33:0/269894358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980b19e0 msgr2=0x7f30980b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f30977fe640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980b19e0 0x7f30980b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.572+0000 7f30977fe640 1 -- 172.21.15.33:0/269894358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30981d8e20 con 0x7f3098142ef0 2024-04-25T15:20:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f9d16361640 1 -- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 msgr2=0x7f9d101de3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f9d16361640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d101de3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f9d16361640 1 -- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d10146b50 msgr2=0x7f9d1013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f9d16361640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d10146b50 0x7f9d1013b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f9d16361640 1 -- 172.21.15.33:0/2919518966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d101de8f0 con 0x7f9d100b5680 2024-04-25T15:20:48.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f30977fe640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098142ef0 0x7f3098143300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f308400d4c0 tx=0x7f308400d980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f60faffd640 1 -- 172.21.15.33:0/3287802685 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f610c0dbda0 con 0x7f61040cb590 2024-04-25T15:20:48.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f9d16361640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d100b5680 0x7f9d101cd490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c7f0 tx=0x7f9d0c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f71e3fff640 1 -- 172.21.15.33:0/1430717115 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec001500 con 0x7f71f00af190 2024-04-25T15:20:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f00cb330 con 0x7f71f00af190 2024-04-25T15:20:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.573+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f00cb8f0 con 0x7f71f00af190 2024-04-25T15:20:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.574+0000 7f88357fa640 1 -- 172.21.15.33:0/1877579132 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f882407fe00 con 0x7f883809d940 2024-04-25T15:20:48.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.575+0000 7f4a857fa640 1 -- 172.21.15.33:0/1994323782 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4a7c018520 con 0x7f4a800323c0 2024-04-25T15:20:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.575+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f00cabc0 con 0x7f71f00af190 2024-04-25T15:20:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.575+0000 7f4a857fa640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4a6c074500 0x7f4a6c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.576+0000 7f4a87fff640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4a6c074500 0x7f4a6c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.576+0000 7f4a87fff640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4a6c074500 0x7f4a6c076a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4a74006fd0 tx=0x7f4a74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.577+0000 7f4d4e7fc640 1 -- 172.21.15.33:0/3374885257 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d5405e5d0 con 0x7f4d50039860 2024-04-25T15:20:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.578+0000 7f3094ff9640 1 -- 172.21.15.33:0/269894358 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30840125f0 con 0x7f3098142ef0 2024-04-25T15:20:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.578+0000 7f3094ff9640 1 -- 172.21.15.33:0/269894358 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3084019070 con 0x7f3098142ef0 2024-04-25T15:20:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.578+0000 7f309e496640 1 -- 172.21.15.33:0/269894358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30980b3140 con 0x7f3098142ef0 2024-04-25T15:20:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.578+0000 7f3094ff9640 1 -- 172.21.15.33:0/269894358 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30840129d0 con 0x7f3098142ef0 2024-04-25T15:20:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.578+0000 7f309e496640 1 -- 172.21.15.33:0/269894358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30981e73a0 con 0x7f3098142ef0 2024-04-25T15:20:48.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.579+0000 7f309e496640 1 -- 172.21.15.33:0/269894358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30980b3470 con 0x7f3098142ef0 2024-04-25T15:20:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.580+0000 7f3094ff9640 1 -- 172.21.15.33:0/269894358 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3084012b70 con 0x7f3098142ef0 2024-04-25T15:20:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.580+0000 7f3094ff9640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f307c0744b0 0x7f307c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.581+0000 7f3094ff9640 1 -- 172.21.15.33:0/269894358 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f30840952c0 con 0x7f3098142ef0 2024-04-25T15:20:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.581+0000 7f3097fff640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f307c0744b0 0x7f307c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.581+0000 7f71e3fff640 1 -- 172.21.15.33:0/1430717115 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f80746a0 con 0x7f71f00af190 2024-04-25T15:20:48.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.581+0000 7f71e3fff640 1 -- 172.21.15.33:0/1430717115 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f8074a50 con 0x7f71f00af190 2024-04-25T15:20:48.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.581+0000 7f9d06ffd640 1 -- 172.21.15.33:0/2919518966 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c015070 con 0x7f9d100b5680 2024-04-25T15:20:48.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.581+0000 7f4a857fa640 1 -- 172.21.15.33:0/1994323782 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4a7c05bb80 con 0x7f4a800323c0 2024-04-25T15:20:48.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.581+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d101d23b0 con 0x7f9d100b5680 2024-04-25T15:20:48.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.581+0000 7f3097fff640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f307c0744b0 0x7f307c0769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f308c032000 tx=0x7f308c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.582+0000 7efd7ffff640 1 -- 172.21.15.33:0/3730319492 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd8805efd0 con 0x7efd98071380 2024-04-25T15:20:48.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.582+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d101ccc70 con 0x7f9d100b5680 2024-04-25T15:20:48.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.583+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d101435b0 con 0x7f9d100b5680 2024-04-25T15:20:48.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.585+0000 7f3094ff9640 1 -- 172.21.15.33:0/269894358 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f308405f3f0 con 0x7f3098142ef0 2024-04-25T15:20:48.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.592+0000 7f4a857fa640 1 -- 172.21.15.33:0/1994323782 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a7c00d070 con 0x7f4a800323c0 2024-04-25T15:20:48.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.594+0000 7f71e3fff640 1 -- 172.21.15.33:0/1430717115 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f71f8096440 con 0x7f71f00af190 2024-04-25T15:20:48.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.594+0000 7f71e3fff640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71dc0744e0 0x7f71dc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.595+0000 7f71e3fff640 1 -- 172.21.15.33:0/1430717115 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f71f81115b0 con 0x7f71f00af190 2024-04-25T15:20:48.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.593+0000 7f9d06ffd640 1 -- 172.21.15.33:0/2919518966 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d0c0079b0 con 0x7f9d100b5680 2024-04-25T15:20:48.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.593+0000 7f9d06ffd640 1 -- 172.21.15.33:0/2919518966 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c01f060 con 0x7f9d100b5680 2024-04-25T15:20:48.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.598+0000 7f9d06ffd640 1 -- 172.21.15.33:0/2919518966 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9d0c018070 con 0x7f9d100b5680 2024-04-25T15:20:48.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.598+0000 7f9d06ffd640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9cf40744b0 0x7f9cf40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:48.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.599+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71dc0744e0 0x7f71dc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.599+0000 7f9d15b60640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9cf40744b0 0x7f9cf40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:48.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.600+0000 7f71f77fe640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71dc0744e0 0x7f71dc0769f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71f000bcb0 tx=0x7f71e402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.600+0000 7f9d15b60640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9cf40744b0 0x7f9cf40769c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9d1006de70 tx=0x7f9d00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:48.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.604+0000 7f71e3fff640 1 -- 172.21.15.33:0/1430717115 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71f809d030 con 0x7f71f00af190 2024-04-25T15:20:48.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.614+0000 7f9d06ffd640 1 -- 172.21.15.33:0/2919518966 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9d0c093b90 con 0x7f9d100b5680 2024-04-25T15:20:48.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:48.614+0000 7f9d06ffd640 1 -- 172.21.15.33:0/2919518966 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9d0c05f720 con 0x7f9d100b5680 2024-04-25T15:20:49.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.003+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f60f0005580 con 0x7f61040cb590 2024-04-25T15:20:49.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.003+0000 7f60faffd640 1 -- 172.21.15.33:0/3287802685 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f610c0db6a0 con 0x7f61040cb590 2024-04-25T15:20:49.005 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-04-25T15:20:49.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.006+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8818005850 con 0x7f883809d940 2024-04-25T15:20:49.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.007+0000 7f88357fa640 1 -- 172.21.15.33:0/1877579132 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8824084100 con 0x7f883809d940 2024-04-25T15:20:49.008 INFO:teuthology.orchestra.run.smithi033.stdout:55834574852 2024-04-25T15:20:49.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.007+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f60ec0745b0 msgr2=0x7f60ec076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.007+0000 7f610b59e640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f60ec0745b0 0x7f60ec076ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60fc000f60 tx=0x7f60fc009040 comp rx=0 tx=0).stop 2024-04-25T15:20:49.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.007+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61040cb590 msgr2=0x7f61040bc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.007+0000 7f610b59e640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61040cb590 0x7f61040bc5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f610c06b670 tx=0x7f610c06eb20 comp rx=0 tx=0).stop 2024-04-25T15:20:49.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 shutdown_connections 2024-04-25T15:20:49.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f610b59e640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f60ec0745b0 0x7f60ec076ac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f610b59e640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61040cb590 0x7f61040bc5b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f610b59e640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6104039a80 0x7f610416a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f610b59e640 1 --2- 172.21.15.33:0/3287802685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6104034900 0x7f61040d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 >> 172.21.15.33:0/3287802685 conn(0x7f6104006270 msgr2=0x7f6104004a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 shutdown_connections 2024-04-25T15:20:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f610b59e640 1 -- 172.21.15.33:0/3287802685 wait complete. 2024-04-25T15:20:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7efd78005580 con 0x7efd98071380 2024-04-25T15:20:49.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.008+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4d500c0130 con 0x7f4d50039860 2024-04-25T15:20:49.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.009+0000 7efd7ffff640 1 -- 172.21.15.33:0/3730319492 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd880632d0 con 0x7efd98071380 2024-04-25T15:20:49.012 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-04-25T15:20:49.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.009+0000 7f4d4e7fc640 1 -- 172.21.15.33:0/3374885257 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d540672f0 con 0x7f4d50039860 2024-04-25T15:20:49.013 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.011+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f881c0744e0 msgr2=0x7f881c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.011+0000 7f883ec92640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f881c0744e0 0x7f881c0769f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f883809eb00 tx=0x7f883000d040 comp rx=0 tx=0).stop 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.011+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 msgr2=0x7f88380b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.011+0000 7f883ec92640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f88380b49b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8824009960 tx=0x7f88240046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 shutdown_connections 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7f883ec92640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f881c0744e0 0x7f881c0769f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7f883ec92640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88380ba810 0x7f883814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7f883ec92640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f883809d940 0x7f88380b49b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7f883ec92640 1 --2- 172.21.15.33:0/1877579132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f883809c270 0x7f88381dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 >> 172.21.15.33:0/1877579132 conn(0x7f88380bb460 msgr2=0x7f883806d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 shutdown_connections 2024-04-25T15:20:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7f883ec92640 1 -- 172.21.15.33:0/1877579132 wait complete. 2024-04-25T15:20:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efd840745b0 msgr2=0x7efd84076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efd840745b0 0x7efd84076ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd90034000 tx=0x7efd9002e000 comp rx=0 tx=0).stop 2024-04-25T15:20:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd98071380 msgr2=0x7efd980ba8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd98071380 0x7efd980ba8b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd8800caa0 tx=0x7efd8800cf60 comp rx=0 tx=0).stop 2024-04-25T15:20:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 shutdown_connections 2024-04-25T15:20:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efd840745b0 0x7efd84076ac0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd90034000 tx=0x7efd9002e000 comp rx=0 tx=0).stop 2024-04-25T15:20:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd981412d0 0x7efd98134970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efd980b84c0 0x7efd98145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 --2- 172.21.15.33:0/3730319492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd98071380 0x7efd980ba8b0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd8800caa0 tx=0x7efd8800cf60 comp rx=0 tx=0).stop 2024-04-25T15:20:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.012+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 >> 172.21.15.33:0/3730319492 conn(0x7efd980b93d0 msgr2=0x7efd980b97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.013+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 shutdown_connections 2024-04-25T15:20:49.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.013+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4d3c0744b0 msgr2=0x7f4d3c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.013+0000 7f4d5ebce640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4d3c0744b0 0x7f4d3c0769c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d48034000 tx=0x7f4d4802e000 comp rx=0 tx=0).stop 2024-04-25T15:20:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.013+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 msgr2=0x7f4d500c17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.013+0000 7f4d5ebce640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d500c17c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000beb0 tx=0x7f4d5400c820 comp rx=0 tx=0).stop 2024-04-25T15:20:49.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.013+0000 7efd9dc67640 1 -- 172.21.15.33:0/3730319492 wait complete. 2024-04-25T15:20:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.015+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 shutdown_connections 2024-04-25T15:20:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.015+0000 7f4d5ebce640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4d3c0744b0 0x7f4d3c0769c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.015+0000 7f4d5ebce640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d500d15a0 0x7f4d500cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.015+0000 7f4d5ebce640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4d50039860 0x7f4d500c17c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.015+0000 7f4d5ebce640 1 --2- 172.21.15.33:0/3374885257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d5000ae90 0x7f4d500c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.015+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 >> 172.21.15.33:0/3374885257 conn(0x7f4d50006270 msgr2=0x7f4d50035f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.015+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 shutdown_connections 2024-04-25T15:20:49.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.015+0000 7f4d5ebce640 1 -- 172.21.15.33:0/3374885257 wait complete. 2024-04-25T15:20:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.019+0000 7f309e496640 1 -- 172.21.15.33:0/269894358 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3098076c00 con 0x7f3098142ef0 2024-04-25T15:20:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.020+0000 7f3094ff9640 1 -- 172.21.15.33:0/269894358 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30840636f0 con 0x7f3098142ef0 2024-04-25T15:20:49.024 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-04-25T15:20:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 -- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f307c0744b0 msgr2=0x7f307c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f307c0744b0 0x7f307c0769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f308c032000 tx=0x7f308c02e000 comp rx=0 tx=0).stop 2024-04-25T15:20:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 -- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098142ef0 msgr2=0x7f3098143300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098142ef0 0x7f3098143300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f308400d4c0 tx=0x7f308400d980 comp rx=0 tx=0).stop 2024-04-25T15:20:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 -- 172.21.15.33:0/269894358 shutdown_connections 2024-04-25T15:20:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f307c0744b0 0x7f307c0769c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980b19e0 0x7f30980b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3098142ef0 0x7f3098143300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.024+0000 7f30827fc640 1 --2- 172.21.15.33:0/269894358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30880039b0 0x7f309814fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.025+0000 7f30827fc640 1 -- 172.21.15.33:0/269894358 >> 172.21.15.33:0/269894358 conn(0x7f309806cfe0 msgr2=0x7f3098145e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:49.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.025+0000 7f30827fc640 1 -- 172.21.15.33:0/269894358 shutdown_connections 2024-04-25T15:20:49.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.025+0000 7f30827fc640 1 -- 172.21.15.33:0/269894358 wait complete. 2024-04-25T15:20:49.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.030+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4a68005850 con 0x7f4a800323c0 2024-04-25T15:20:49.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.030+0000 7f4a857fa640 1 -- 172.21.15.33:0/1994323782 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a7c05fff0 con 0x7f4a800323c0 2024-04-25T15:20:49.032 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2024-04-25T15:20:49.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-04-25T15:20:49.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-04-25T15:20:49.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-25T15:20:49.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4a6c074500 msgr2=0x7f4a6c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4a6c074500 0x7f4a6c076a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4a74006fd0 tx=0x7f4a74008040 comp rx=0 tx=0).stop 2024-04-25T15:20:49.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800323c0 msgr2=0x7f4a800c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800323c0 0x7f4a800c9580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00aa80 tx=0x7f4a7c00af40 comp rx=0 tx=0).stop 2024-04-25T15:20:49.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 shutdown_connections 2024-04-25T15:20:49.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4a6c074500 0x7f4a6c076a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a800c3810 0x7f4a800c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a800396b0 0x7f4a8015e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 --2- 172.21.15.33:0/1994323782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a800323c0 0x7f4a800c9580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 >> 172.21.15.33:0/1994323782 conn(0x7f4a8003b7b0 msgr2=0x7f4a800cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:49.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.034+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 shutdown_connections 2024-04-25T15:20:49.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.035+0000 7f4a8de97640 1 -- 172.21.15.33:0/1994323782 wait complete. 2024-04-25T15:20:49.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-04-25T15:20:49.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.039+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f71f0005570 con 0x7f71f00af190 2024-04-25T15:20:49.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.040+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9d100764e0 con 0x7f9d100b5680 2024-04-25T15:20:49.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.040+0000 7f71e3fff640 1 -- 172.21.15.33:0/1430717115 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71f8074bf0 con 0x7f71f00af190 2024-04-25T15:20:49.042 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-04-25T15:20:49.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.040+0000 7f9d06ffd640 1 -- 172.21.15.33:0/2919518966 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d0c063a20 con 0x7f9d100b5680 2024-04-25T15:20:49.042 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2024-04-25T15:20:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9cf40744b0 msgr2=0x7f9cf40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9cf40744b0 0x7f9cf40769c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9d1006de70 tx=0x7f9d00008040 comp rx=0 tx=0).stop 2024-04-25T15:20:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d100b5680 msgr2=0x7f9d101cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d100b5680 0x7f9d101cd490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c00c7f0 tx=0x7f9d0c00ccb0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 shutdown_connections 2024-04-25T15:20:49.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9cf40744b0 0x7f9cf40769c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d10146b50 0x7f9d1013b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d10140810 0x7f9d101de3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 --2- 172.21.15.33:0/2919518966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d100b5680 0x7f9d101cd490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.042+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 >> 172.21.15.33:0/2919518966 conn(0x7f9d1006ce70 msgr2=0x7f9d100b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:49.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-04-25T15:20:49.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 shutdown_connections 2024-04-25T15:20:49.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f9d185c5640 1 -- 172.21.15.33:0/2919518966 wait complete. 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71dc0744e0 msgr2=0x7f71dc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71dc0744e0 0x7f71dc0769f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71f000bcb0 tx=0x7f71e402e000 comp rx=0 tx=0).stop 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71f00af190 msgr2=0x7f71f0166210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71f00af190 0x7f71f0166210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71f8066010 tx=0x7f71f806ee10 comp rx=0 tx=0).stop 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 shutdown_connections 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71dc0744e0 0x7f71dc0769f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71f00af190 0x7f71f0166210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71f00cbe10 0x7f71f00aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 --2- 172.21.15.33:0/1430717115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e8003b40 0x7f71f00d8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:49.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.043+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 >> 172.21.15.33:0/1430717115 conn(0x7f71f0006270 msgr2=0x7f71f00c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:49.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.044+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 shutdown_connections 2024-04-25T15:20:49.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:49.044+0000 7f71fca4d640 1 -- 172.21.15.33:0/1430717115 wait complete. 2024-04-25T15:20:49.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-25T15:20:49.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-04-25T15:20:49.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-25T15:20:50.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T15:20:50.036 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T15:20:50.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T15:20:50.039 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T15:20:50.046 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T15:20:50.052 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T15:20:50.058 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T15:20:50.058 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T15:20:50.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.231+0000 7fb8042f2640 1 Processor -- start 2024-04-25T15:20:50.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.231+0000 7fb8042f2640 1 -- start start 2024-04-25T15:20:50.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.231+0000 7fde85a49640 1 Processor -- start 2024-04-25T15:20:50.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.231+0000 7f9fede15640 1 Processor -- start 2024-04-25T15:20:50.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.231+0000 7f9fede15640 1 -- start start 2024-04-25T15:20:50.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.232+0000 7fde85a49640 1 -- start start 2024-04-25T15:20:50.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.233+0000 7f8d4ec76640 1 Processor -- start 2024-04-25T15:20:50.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.233+0000 7fb8042f2640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb7fc0b7d80 0x7fb7fc0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.233+0000 7f8d4ec76640 1 -- start start 2024-04-25T15:20:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.233+0000 7f9fede15640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9fe80b4130 0x7f9fe80737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.233+0000 7f9fede15640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe80b2dc0 con 0x7f9fe80b6df0 2024-04-25T15:20:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.233+0000 7f9fede15640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe80b3050 con 0x7f9fe8141500 2024-04-25T15:20:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.233+0000 7f9fede15640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe80b6960 con 0x7f9fe80b4130 2024-04-25T15:20:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7fde85a49640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 0x7fde8013f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.233+0000 7fb80188d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb7fc0b7d80 0x7fb7fc0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7fde7e7fc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fde80145de0 0x7fde80071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45270/0 (socket says 172.21.15.33:45270) 2024-04-25T15:20:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7fde7ffff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fde80071b70 0x7fde8014fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:49172/0 (socket says 172.21.15.33:49172) 2024-04-25T15:20:50.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7fde7ffff640 1 -- 172.21.15.33:0/1905710203 learned_addr learned my addr 172.21.15.33:0/1905710203 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7fb80188d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb7fc0b7d80 0x7fb7fc0b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51316/0 (socket says 172.21.15.33:51316) 2024-04-25T15:20:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7fb80188d640 1 -- 172.21.15.33:0/2103367547 learned_addr learned my addr 172.21.15.33:0/2103367547 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7fde85a49640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde800b4dd0 con 0x7fde80145de0 2024-04-25T15:20:50.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7fb8042f2640 1 -- 172.21.15.33:0/2103367547 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc149cb0 con 0x7fb7fc0bc430 2024-04-25T15:20:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7fb8042f2640 1 -- 172.21.15.33:0/2103367547 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc149f90 con 0x7fb7fc0b8190 2024-04-25T15:20:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7fb8042f2640 1 -- 172.21.15.33:0/2103367547 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fb7fc149a60 con 0x7fb7fc0b7d80 2024-04-25T15:20:50.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7fde85a49640 1 -- 172.21.15.33:0/1905710203 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde800720c0 con 0x7fde80071b70 2024-04-25T15:20:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7fde85a49640 1 -- 172.21.15.33:0/1905710203 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde80145950 con 0x7fde800729f0 2024-04-25T15:20:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7fde7effd640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 0x7fde8013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119490383 0 0) 0x7fde800720c0 con 0x7fde80071b70 2024-04-25T15:20:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7f9fe77fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9fe80b6df0 0x7f9fe80b26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45254/0 (socket says 172.21.15.33:45254) 2024-04-25T15:20:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde6c003520 con 0x7fde80071b70 2024-04-25T15:20:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7f8d4ec76640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d400383e0 0x7f8d400387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7f8d4ec76640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8d400c9a10 0x7f8d400c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.235+0000 7f8d4dc74640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8d40035b50 0x7f8d40034bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45280/0 (socket says 172.21.15.33:45280) 2024-04-25T15:20:50.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7f8d4d473640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d400383e0 0x7f8d400387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7f8d4d473640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d400383e0 0x7f8d400387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51140/0 (socket says 172.21.15.33:51140) 2024-04-25T15:20:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7f8d4ec76640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d400371e0 con 0x7f8d40035b50 2024-04-25T15:20:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7f8d4ec76640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f8d400374c0 con 0x7f8d400c9a10 2024-04-25T15:20:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7f8d4ec76640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8d400377a0 con 0x7f8d400383e0 2024-04-25T15:20:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 181718016 0 0) 0x7fde6c003520 con 0x7fde80071b70 2024-04-25T15:20:50.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 msgr2=0x7fde8013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 0x7fde8013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 >> v1:172.21.15.33:6789/0 conn(0x7fde80145de0 legacy=0x7fde80071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde80072e00 con 0x7fde80071b70 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7fde78001a20 con 0x7fde80071b70 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7effd640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 0x7fde8013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 >> v1:172.21.15.155:6789/0 conn(0x7fde80071b70 legacy=0x7fde8014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c0039b0 0x7fde6c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde6c004800 0x7fde6c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 0x7fde6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fde80145950 con 0x7fde6c004800 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c005550 con 0x7fde6c0039b0 2024-04-25T15:20:50.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde6c00bf20 con 0x7fde800729f0 2024-04-25T15:20:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7f8d4dc74640 1 -- 172.21.15.33:0/2121953473 learned_addr learned my addr 172.21.15.33:0/2121953473 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7f8d4e475640 1 --2- 172.21.15.33:0/2121953473 >> v2:172.21.15.33:3300/0 conn(0x7f8d400c9a10 0x7f8d400c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fb80108c640 1 -- 172.21.15.33:0/2103367547 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2483691766 0 0) 0x7fb7fc149f90 con 0x7fb7fc0b8190 2024-04-25T15:20:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fb80108c640 1 -- 172.21.15.33:0/2103367547 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e4003520 con 0x7fb7fc0b8190 2024-04-25T15:20:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fb80188d640 1 -- 172.21.15.33:0/2103367547 >> v1:172.21.15.155:6789/0 conn(0x7fb7fc0b8190 legacy=0x7fb7fc150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fb80188d640 1 -- 172.21.15.33:0/2103367547 >> v1:172.21.15.33:6789/0 conn(0x7fb7fc0bc430 legacy=0x7fb7fc146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7fb80188d640 1 -- 172.21.15.33:0/2103367547 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc14a270 con 0x7fb7fc0b7d80 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7effd640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c0039b0 0x7fde6c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7ffff640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 0x7fde6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.236+0000 7fde7e7fc640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde6c004800 0x7fde6c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7fde7effd640 1 -- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 msgr2=0x7fde6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7fde7effd640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde800729f0 0x7fde6c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7fde7effd640 1 -- 172.21.15.33:0/1905710203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde6c004800 msgr2=0x7fde6c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7fde7effd640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde6c004800 0x7fde6c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7fde7effd640 1 -- 172.21.15.33:0/1905710203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde80072e00 con 0x7fde6c0039b0 2024-04-25T15:20:50.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7f8d4d473640 1 -- 172.21.15.33:0/2121953473 >> v2:172.21.15.33:3300/0 conn(0x7f8d400c9a10 msgr2=0x7f8d400c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7f8d4d473640 1 --2- 172.21.15.33:0/2121953473 >> v2:172.21.15.33:3300/0 conn(0x7f8d400c9a10 0x7f8d400c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7f8d4d473640 1 -- 172.21.15.33:0/2121953473 >> v1:172.21.15.33:6789/0 conn(0x7f8d40035b50 legacy=0x7f8d40034bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7f8d4d473640 1 -- 172.21.15.33:0/2121953473 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d40035300 con 0x7f8d400383e0 2024-04-25T15:20:50.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7f9fe77fe640 1 -- 172.21.15.33:0/2378441227 learned_addr learned my addr 172.21.15.33:0/2378441227 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:50.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7f9fe6ffd640 1 --2- 172.21.15.33:0/2378441227 >> v2:172.21.15.155:3300/0 conn(0x7f9fe80b4130 0x7f9fe80737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7f9fe6ffd640 1 -- 172.21.15.33:0/2378441227 >> v1:172.21.15.155:6789/0 conn(0x7f9fe8141500 legacy=0x7f9fe8151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7f9fe6ffd640 1 -- 172.21.15.33:0/2378441227 >> v1:172.21.15.33:6789/0 conn(0x7f9fe80b6df0 legacy=0x7f9fe80b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.234+0000 7f9fe6ffd640 1 -- 172.21.15.33:0/2378441227 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe80b65f0 con 0x7f9fe80b4130 2024-04-25T15:20:50.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.237+0000 7f9fe6ffd640 1 --2- 172.21.15.33:0/2378441227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe80b4130 0x7f9fe80737e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009e10 tx=0x7f9fe0032ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=457a35c59ed8e974 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7fb80188d640 1 --2- 172.21.15.33:0/2103367547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b7d80 0x7fb7fc0b57d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009e50 tx=0x7fb7ec02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba40de530893551 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7fde7effd640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c0039b0 0x7fde6c003e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fde800b1960 tx=0x7fde6c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=918ecae3a51b711c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7fb80108c640 1 -- 172.21.15.33:0/2103367547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec036070 con 0x7fb7fc0b7d80 2024-04-25T15:20:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7f8d4d473640 1 --2- 172.21.15.33:0/2121953473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400383e0 0x7f8d400387f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d40039050 tx=0x7f8d3802a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392e75eb4dc8222 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7fb80108c640 1 -- 172.21.15.33:0/2103367547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec031600 con 0x7fb7fc0b7d80 2024-04-25T15:20:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7fb80108c640 1 -- 172.21.15.33:0/2103367547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0319d0 con 0x7fb7fc0b7d80 2024-04-25T15:20:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde680091c0 con 0x7fde6c0039b0 2024-04-25T15:20:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde68004020 con 0x7fde6c0039b0 2024-04-25T15:20:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7fde7dffb640 1 -- 172.21.15.33:0/1905710203 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde680091c0 con 0x7fde6c0039b0 2024-04-25T15:20:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7f9fe67fc640 1 -- 172.21.15.33:0/2378441227 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0040070 con 0x7f9fe80b4130 2024-04-25T15:20:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7f9fe67fc640 1 -- 172.21.15.33:0/2378441227 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe0033bf0 con 0x7f9fe80b4130 2024-04-25T15:20:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.238+0000 7f9fe67fc640 1 -- 172.21.15.33:0/2378441227 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe003b440 con 0x7f9fe80b4130 2024-04-25T15:20:50.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.239+0000 7fb8042f2640 1 -- 172.21.15.33:0/2103367547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b7d80 msgr2=0x7fb7fc0b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.239+0000 7fb8042f2640 1 --2- 172.21.15.33:0/2103367547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b7d80 0x7fb7fc0b57d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009e50 tx=0x7fb7ec02a6d0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.239+0000 7f8d4cc72640 1 -- 172.21.15.33:0/2121953473 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38037070 con 0x7f8d400383e0 2024-04-25T15:20:50.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fb8042f2640 1 -- 172.21.15.33:0/2103367547 shutdown_connections 2024-04-25T15:20:50.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fb8042f2640 1 --2- 172.21.15.33:0/2103367547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b7d80 0x7fb7fc0b57d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fb8042f2640 1 -- 172.21.15.33:0/2103367547 >> 172.21.15.33:0/2103367547 conn(0x7fb7fc06dd00 msgr2=0x7fb7fc0bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f9fede15640 1 -- 172.21.15.33:0/2378441227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe80b4130 msgr2=0x7f9fe80737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f9fede15640 1 --2- 172.21.15.33:0/2378441227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe80b4130 0x7f9fe80737e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009e10 tx=0x7f9fe0032ea0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.239+0000 7fde85a49640 1 -- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c0039b0 msgr2=0x7fde6c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.239+0000 7fde85a49640 1 --2- 172.21.15.33:0/1905710203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c0039b0 0x7fde6c003e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fde800b1960 tx=0x7fde6c005830 comp rx=0 tx=0).stop 2024-04-25T15:20:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fde7ffff640 1 -- 172.21.15.33:0/1905710203 reap_dead start 2024-04-25T15:20:50.251 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fde85a49640 1 -- 172.21.15.33:0/1905710203 shutdown_connections 2024-04-25T15:20:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fde85a49640 1 -- 172.21.15.33:0/1905710203 >> 172.21.15.33:0/1905710203 conn(0x7fde800ba8b0 msgr2=0x7fde800bacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.239+0000 7f8d4cc72640 1 -- 172.21.15.33:0/2121953473 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d3802adf0 con 0x7f8d400383e0 2024-04-25T15:20:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.239+0000 7f8d4cc72640 1 -- 172.21.15.33:0/2121953473 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38032640 con 0x7f8d400383e0 2024-04-25T15:20:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2121953473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400383e0 msgr2=0x7f8d400387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.252 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fb8042f2640 1 -- 172.21.15.33:0/2103367547 shutdown_connections 2024-04-25T15:20:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f8d4ec76640 1 --2- 172.21.15.33:0/2121953473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400383e0 0x7f8d400387f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d40039050 tx=0x7f8d3802a0a0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f9fede15640 1 -- 172.21.15.33:0/2378441227 shutdown_connections 2024-04-25T15:20:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f9fede15640 1 --2- 172.21.15.33:0/2378441227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe80b4130 0x7f9fe80737e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f9fede15640 1 -- 172.21.15.33:0/2378441227 >> 172.21.15.33:0/2378441227 conn(0x7f9fe806ce70 msgr2=0x7f9fe80ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2121953473 shutdown_connections 2024-04-25T15:20:50.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f8d4ec76640 1 --2- 172.21.15.33:0/2121953473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400383e0 0x7f8d400387f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f8d4ec76640 1 --2- 172.21.15.33:0/2121953473 >> v2:172.21.15.33:3300/0 conn(0x7f8d400c9a10 0x7f8d400c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2121953473 >> 172.21.15.33:0/2121953473 conn(0x7f8d4003f160 msgr2=0x7f8d4003f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f9fede15640 1 -- 172.21.15.33:0/2378441227 shutdown_connections 2024-04-25T15:20:50.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2121953473 shutdown_connections 2024-04-25T15:20:50.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7f9fede15640 1 -- 172.21.15.33:0/2378441227 wait complete. 2024-04-25T15:20:50.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fb8042f2640 1 -- 172.21.15.33:0/2103367547 wait complete. 2024-04-25T15:20:50.255 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.240+0000 7fde85a49640 1 -- 172.21.15.33:0/1905710203 shutdown_connections 2024-04-25T15:20:50.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.241+0000 7fde85a49640 1 -- 172.21.15.33:0/1905710203 wait complete. 2024-04-25T15:20:50.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.243+0000 7fb8042f2640 1 Processor -- start 2024-04-25T15:20:50.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.243+0000 7f9fede15640 1 Processor -- start 2024-04-25T15:20:50.256 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.243+0000 7fb8042f2640 1 -- start start 2024-04-25T15:20:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.243+0000 7fde85a49640 1 Processor -- start 2024-04-25T15:20:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.243+0000 7fde85a49640 1 -- start start 2024-04-25T15:20:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.243+0000 7f9fede15640 1 -- start start 2024-04-25T15:20:50.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f9fede15640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fe80b4130 0x7f9fe814a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7fb8042f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc0b7d80 0x7fb7fc0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f9fede15640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fe80b6df0 0x7f9fe81488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7fb8042f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b8190 0x7fb7fc0ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7fde85a49640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde801488c0 0x7fde801deb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f9fe77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fe80b4130 0x7f9fe814a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.241+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2121953473 wait complete. 2024-04-25T15:20:50.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7fb80188d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b8190 0x7fb7fc0ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.244+0000 7f8d4ec76640 1 Processor -- start 2024-04-25T15:20:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.244+0000 7f8d4ec76640 1 -- start start 2024-04-25T15:20:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb80188d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b8190 0x7fb7fc0ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51352/0 (socket says 172.21.15.33:51352) 2024-04-25T15:20:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f8d4ec76640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d40035b50 0x7f8d4003de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f8d4ec76640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d400383e0 0x7f8d400c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f8d4ec76640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400c9a10 0x7f8d400c0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f8d4ec76640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40036d50 con 0x7f8d400383e0 2024-04-25T15:20:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4ec76640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400ca360 con 0x7f8d400c9a10 2024-04-25T15:20:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb80208e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc0b7d80 0x7fb7fc0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4ec76640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d40036ed0 con 0x7f8d40035b50 2024-04-25T15:20:50.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4dc74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d40035b50 0x7f8d4003de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb80208e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc0b7d80 0x7fb7fc0aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45684/0 (socket says 172.21.15.33:45684) 2024-04-25T15:20:50.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb80188d640 1 -- 172.21.15.33:0/1575937650 learned_addr learned my addr 172.21.15.33:0/1575937650 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f9fe77fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fe80b4130 0x7f9fe814a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45680/0 (socket says 172.21.15.33:45680) 2024-04-25T15:20:50.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f9fe6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fe80b6df0 0x7f9fe81488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb8042f2640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7fc0bc430 0x7fb7fc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fde85a49640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde801df050 0x7fde801db460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb8042f2640 1 -- 172.21.15.33:0/1575937650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc14a790 con 0x7fb7fc0b8190 2024-04-25T15:20:50.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.245+0000 7f9fe6ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fe80b6df0 0x7f9fe81488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51338/0 (socket says 172.21.15.33:51338) 2024-04-25T15:20:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f9fe77fe640 1 -- 172.21.15.33:0/2872531302 learned_addr learned my addr 172.21.15.33:0/2872531302 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb8042f2640 1 -- 172.21.15.33:0/1575937650 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc0b31d0 con 0x7fb7fc0bc430 2024-04-25T15:20:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb8042f2640 1 -- 172.21.15.33:0/1575937650 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc14a910 con 0x7fb7fc0b7d80 2024-04-25T15:20:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fb80288f640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7fc0bc430 0x7fb7fc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fde85a49640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80148cd0 0x7fde801db9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4dc74640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d40035b50 0x7f8d4003de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45700/0 (socket says 172.21.15.33:45700) 2024-04-25T15:20:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4dc74640 1 -- 172.21.15.33:0/2395309301 learned_addr learned my addr 172.21.15.33:0/2395309301 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4e475640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400c9a10 0x7f8d400c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fde7e7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde801df050 0x7fde801db460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fde7effd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde801488c0 0x7fde801deb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4e475640 1 -- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d40035b50 msgr2=0x7f8d4003de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f9fede15640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe8141500 0x7f9fe813a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe80b2060 con 0x7f9fe80b6df0 2024-04-25T15:20:50.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe80b1ee0 con 0x7f9fe8141500 2024-04-25T15:20:50.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe8141910 con 0x7f9fe80b4130 2024-04-25T15:20:50.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f9fe7fff640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe8141500 0x7f9fe813a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fde7effd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde801488c0 0x7fde801deb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45710/0 (socket says 172.21.15.33:45710) 2024-04-25T15:20:50.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7fde7e7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde801df050 0x7fde801db460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51190/0 (socket says 172.21.15.33:51190) 2024-04-25T15:20:50.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f9fe77fe640 1 -- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe8141500 msgr2=0x7f9fe813a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fde7effd640 1 -- 172.21.15.33:0/793930436 learned_addr learned my addr 172.21.15.33:0/793930436 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fde8006fae0 con 0x7fde80148cd0 2024-04-25T15:20:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f9fe77fe640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe8141500 0x7f9fe813a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f9fe77fe640 1 -- 172.21.15.33:0/2872531302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fe80b6df0 msgr2=0x7f9fe81488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f9fe77fe640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fe80b6df0 0x7f9fe81488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f9fe77fe640 1 -- 172.21.15.33:0/2872531302 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe814aa50 con 0x7f9fe80b4130 2024-04-25T15:20:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4e475640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d40035b50 0x7f8d4003de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fb80188d640 1 -- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc0b7d80 msgr2=0x7fb7fc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fb80188d640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc0b7d80 0x7fb7fc0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fb80188d640 1 -- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7fc0bc430 msgr2=0x7fb7fc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fb80188d640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7fc0bc430 0x7fb7fc0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fb80188d640 1 -- 172.21.15.33:0/1575937650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc0ab3b0 con 0x7fb7fc0b8190 2024-04-25T15:20:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f9fe77fe640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fe80b4130 0x7f9fe814a510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c3c0 tx=0x7f9fd800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.246+0000 7f8d4e475640 1 -- 172.21.15.33:0/2395309301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d400383e0 msgr2=0x7f8d400c7110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:20:50.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fb80288f640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7fc0bc430 0x7fb7fc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fde7ffff640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80148cd0 0x7fde801db9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde800b52b0 con 0x7fde801df050 2024-04-25T15:20:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f8d4d473640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d400383e0 0x7f8d400c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde8006fc60 con 0x7fde801488c0 2024-04-25T15:20:50.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f9fcffff640 1 -- 172.21.15.33:0/2872531302 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8017070 con 0x7f9fe80b4130 2024-04-25T15:20:50.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f8d4e475640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d400383e0 0x7f8d400c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f9fcffff640 1 -- 172.21.15.33:0/2872531302 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd8005ce0 con 0x7f9fe80b4130 2024-04-25T15:20:50.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.247+0000 7f8d4e475640 1 -- 172.21.15.33:0/2395309301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d40152620 con 0x7f8d400c9a10 2024-04-25T15:20:50.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f8d4e475640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400c9a10 0x7f8d400c0320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d480514f0 tx=0x7f8d4806eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f8d3e7fc640 1 -- 172.21.15.33:0/2395309301 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48081070 con 0x7f8d400c9a10 2024-04-25T15:20:50.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f8d3e7fc640 1 -- 172.21.15.33:0/2395309301 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4806ee50 con 0x7f8d400c9a10 2024-04-25T15:20:50.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2395309301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d400c6bf0 con 0x7f8d400c9a10 2024-04-25T15:20:50.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2395309301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4003e590 con 0x7f8d400c9a10 2024-04-25T15:20:50.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f8d3e7fc640 1 -- 172.21.15.33:0/2395309301 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48074900 con 0x7f8d400c9a10 2024-04-25T15:20:50.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe81deed0 con 0x7f9fe80b4130 2024-04-25T15:20:50.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7fde7e7fc640 1 -- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde801488c0 msgr2=0x7fde801deb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7fde7e7fc640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde801488c0 0x7fde801deb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7fde7e7fc640 1 -- 172.21.15.33:0/793930436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80148cd0 msgr2=0x7fde801db9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7fde7e7fc640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80148cd0 0x7fde801db9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7fde7e7fc640 1 -- 172.21.15.33:0/793930436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde801497a0 con 0x7fde801df050 2024-04-25T15:20:50.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.249+0000 7fde7e7fc640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde801df050 0x7fde801db460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde7000e460 tx=0x7fde7000e920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe8148df0 con 0x7f9fe80b4130 2024-04-25T15:20:50.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.249+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe80764e0 con 0x7f9fe80b4130 2024-04-25T15:20:50.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.251+0000 7fde77fff640 1 -- 172.21.15.33:0/793930436 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70019070 con 0x7fde801df050 2024-04-25T15:20:50.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.251+0000 7fde77fff640 1 -- 172.21.15.33:0/793930436 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde70004c10 con 0x7fde801df050 2024-04-25T15:20:50.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.251+0000 7fde77fff640 1 -- 172.21.15.33:0/793930436 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde700060d0 con 0x7fde801df050 2024-04-25T15:20:50.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7fb80188d640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b8190 0x7fb7fc0ac2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec034040 tx=0x7fb7ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7fb7faffd640 1 -- 172.21.15.33:0/1575937650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec047070 con 0x7fb7fc0b8190 2024-04-25T15:20:50.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.248+0000 7fb7faffd640 1 -- 172.21.15.33:0/1575937650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec03a310 con 0x7fb7fc0b8190 2024-04-25T15:20:50.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.250+0000 7fb7faffd640 1 -- 172.21.15.33:0/1575937650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec036040 con 0x7fb7fc0b8190 2024-04-25T15:20:50.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.250+0000 7fb8042f2640 1 -- 172.21.15.33:0/1575937650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7fc0abbe0 con 0x7fb7fc0b8190 2024-04-25T15:20:50.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.250+0000 7fb8042f2640 1 -- 172.21.15.33:0/1575937650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7fc1e1bb0 con 0x7fb7fc0b8190 2024-04-25T15:20:50.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.252+0000 7f9fcffff640 1 -- 172.21.15.33:0/2872531302 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80072d0 con 0x7f9fe80b4130 2024-04-25T15:20:50.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.252+0000 7f9fcffff640 1 -- 172.21.15.33:0/2872531302 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9fd801a070 con 0x7f9fe80b4130 2024-04-25T15:20:50.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.251+0000 7f8d3e7fc640 1 -- 172.21.15.33:0/2395309301 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8d4808c060 con 0x7f8d400c9a10 2024-04-25T15:20:50.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.252+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2395309301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d30005290 con 0x7f8d400c9a10 2024-04-25T15:20:50.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.252+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde801daea0 con 0x7fde801df050 2024-04-25T15:20:50.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.252+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde801de5f0 con 0x7fde801df050 2024-04-25T15:20:50.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.253+0000 7f8d3e7fc640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8d2c074580 0x7f8d2c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.253+0000 7f9fcffff640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9fd40744e0 0x7f9fd40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.253+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde801de410 con 0x7fde801df050 2024-04-25T15:20:50.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.254+0000 7f9fe6ffd640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9fd40744e0 0x7f9fd40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.254+0000 7f8d3e7fc640 1 -- 172.21.15.33:0/2395309301 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8d480fffd0 con 0x7f8d400c9a10 2024-04-25T15:20:50.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.254+0000 7f8d4dc74640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8d2c074580 0x7f8d2c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.254+0000 7f9fcffff640 1 -- 172.21.15.33:0/2872531302 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9fd8094940 con 0x7f9fe80b4130 2024-04-25T15:20:50.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.253+0000 7fb7faffd640 1 -- 172.21.15.33:0/1575937650 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb7ec04a070 con 0x7fb7fc0b8190 2024-04-25T15:20:50.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.254+0000 7fb7faffd640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb7e80745b0 0x7fb7e8076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.254+0000 7fb7faffd640 1 -- 172.21.15.33:0/1575937650 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb7ec0bdd50 con 0x7fb7fc0b8190 2024-04-25T15:20:50.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.254+0000 7fb80208e640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb7e80745b0 0x7fb7e8076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.254+0000 7f9fe6ffd640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9fd40744e0 0x7f9fd40769f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9fe003d000 tx=0x7f9fe0037000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.255+0000 7f8d4dc74640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8d2c074580 0x7f8d2c076a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8d44004e40 tx=0x7f8d44007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.255+0000 7fb80208e640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb7e80745b0 0x7fb7e8076ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4006fd0 tx=0x7fb7f4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.255+0000 7fb8042f2640 1 -- 172.21.15.33:0/1575937650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7fc0764e0 con 0x7fb7fc0b8190 2024-04-25T15:20:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.255+0000 7f9fcffff640 1 -- 172.21.15.33:0/2872531302 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9fd805eaf0 con 0x7f9fe80b4130 2024-04-25T15:20:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.256+0000 7fde77fff640 1 -- 172.21.15.33:0/793930436 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fde7001c070 con 0x7fde801df050 2024-04-25T15:20:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.256+0000 7fde77fff640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde60074580 0x7fde60076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.257+0000 7fde77fff640 1 -- 172.21.15.33:0/793930436 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fde70094830 con 0x7fde801df050 2024-04-25T15:20:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.257+0000 7fde7effd640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde60074580 0x7fde60076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.257+0000 7fde7effd640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde60074580 0x7fde60076a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde800733b0 tx=0x7fde68030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.259+0000 7f8d3e7fc640 1 -- 172.21.15.33:0/2395309301 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d480ca7d0 con 0x7f8d400c9a10 2024-04-25T15:20:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.263+0000 7fde77fff640 1 -- 172.21.15.33:0/793930436 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde801de410 con 0x7fde801df050 2024-04-25T15:20:50.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.266+0000 7fb7faffd640 1 -- 172.21.15.33:0/1575937650 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb7ec051070 con 0x7fb7fc0b8190 2024-04-25T15:20:50.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.291+0000 7fdda0cee640 1 Processor -- start 2024-04-25T15:20:50.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.291+0000 7fdda0cee640 1 -- start start 2024-04-25T15:20:50.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.290+0000 7f9c6165a640 1 Processor -- start 2024-04-25T15:20:50.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.290+0000 7f9c6165a640 1 -- start start 2024-04-25T15:20:50.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c6165a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c5c14d130 0x7f9c5c0a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c6165a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09c690 0x7f9c5c09caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c6165a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5c14d9a0 con 0x7f9c5c09da70 2024-04-25T15:20:50.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c6165a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f9c5c09d550 con 0x7f9c5c14d130 2024-04-25T15:20:50.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c6165a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5c14d540 con 0x7f9c5c09c690 2024-04-25T15:20:50.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c5b7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9c5c09da70 0x7f9c5c09de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:49192/0 (socket says 172.21.15.33:49192) 2024-04-25T15:20:50.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c5b7fe640 1 -- 172.21.15.33:0/2193846304 learned_addr learned my addr 172.21.15.33:0/2193846304 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:50.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c5affd640 1 --2- 172.21.15.33:0/2193846304 >> v2:172.21.15.33:3300/0 conn(0x7f9c5c14d130 0x7f9c5c0a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.292+0000 7f9c53fff640 1 --2- 172.21.15.33:0/2193846304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09c690 0x7f9c5c09caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f602c3b2640 1 Processor -- start 2024-04-25T15:20:50.297 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f9c5a7fc640 1 -- 172.21.15.33:0/2193846304 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060563784 0 0) 0x7f9c5c14d9a0 con 0x7f9c5c09da70 2024-04-25T15:20:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f9c5a7fc640 1 -- 172.21.15.33:0/2193846304 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c48003520 con 0x7f9c5c09da70 2024-04-25T15:20:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f9c53fff640 1 -- 172.21.15.33:0/2193846304 >> v2:172.21.15.33:3300/0 conn(0x7f9c5c14d130 msgr2=0x7f9c5c0a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f9c53fff640 1 --2- 172.21.15.33:0/2193846304 >> v2:172.21.15.33:3300/0 conn(0x7f9c5c14d130 0x7f9c5c0a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f9c53fff640 1 -- 172.21.15.33:0/2193846304 >> v1:172.21.15.155:6789/0 conn(0x7f9c5c09da70 legacy=0x7f9c5c09de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f9c53fff640 1 -- 172.21.15.33:0/2193846304 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5c14d6c0 con 0x7f9c5c09c690 2024-04-25T15:20:50.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f9c5affd640 1 --2- 172.21.15.33:0/2193846304 >> v2:172.21.15.33:3300/0 conn(0x7f9c5c14d130 0x7f9c5c0a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:50.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7f602c3b2640 1 -- start start 2024-04-25T15:20:50.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7faae146f640 1 Processor -- start 2024-04-25T15:20:50.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7fdda0cee640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdd9c0bc430 0x7fdd9c146470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.293+0000 7fdda0cee640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdd9c0b7d80 0x7fdd9c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7fdd9ad9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdd9c0b8190 0x7fdd9c072520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45284/0 (socket says 172.21.15.33:45284) 2024-04-25T15:20:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7fdd9ad9d640 1 -- 172.21.15.33:0/3062865434 learned_addr learned my addr 172.21.15.33:0/3062865434 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7fdd99d9b640 1 --2- 172.21.15.33:0/3062865434 >> v2:172.21.15.155:3300/0 conn(0x7fdd9c0b7d80 0x7fdd9c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7f9c53fff640 1 --2- 172.21.15.33:0/2193846304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09c690 0x7f9c5c09caa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c440097a0 tx=0x7f9c4402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad55ec7f12f2195 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7fdda0cee640 1 -- 172.21.15.33:0/3062865434 --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd9c149cb0 con 0x7fdd9c0b8190 2024-04-25T15:20:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7faae146f640 1 -- start start 2024-04-25T15:20:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7fdda0cee640 1 -- 172.21.15.33:0/3062865434 --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fdd9c149a60 con 0x7fdd9c0bc430 2024-04-25T15:20:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7fdda0cee640 1 -- 172.21.15.33:0/3062865434 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdd9c0b31d0 con 0x7fdd9c0b7d80 2024-04-25T15:20:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7f9c5a7fc640 1 -- 172.21.15.33:0/2193846304 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44037070 con 0x7f9c5c09c690 2024-04-25T15:20:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7f9c5a7fc640 1 -- 172.21.15.33:0/2193846304 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4402ae40 con 0x7f9c5c09c690 2024-04-25T15:20:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.294+0000 7fdd9a59c640 1 --2- 172.21.15.33:0/3062865434 >> v2:172.21.15.33:3300/0 conn(0x7fdd9c0bc430 0x7fdd9c146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7f602c3b2640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60240b1940 0x7f60240afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7f602c3b2640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6024148380 con 0x7f602406f990 2024-04-25T15:20:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7f602c3b2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60240b6eb0 con 0x7f602406f2d0 2024-04-25T15:20:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7f602c3b2640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f60240b1170 con 0x7f60240b1940 2024-04-25T15:20:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7f9c5a7fc640 1 -- 172.21.15.33:0/2193846304 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44032660 con 0x7f9c5c09c690 2024-04-25T15:20:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7f602994d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f602406f990 0x7f6024147c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45290/0 (socket says 172.21.15.33:45290) 2024-04-25T15:20:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7f602994d640 1 -- 172.21.15.33:0/3687965181 learned_addr learned my addr 172.21.15.33:0/3687965181 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7f602a14e640 1 --2- 172.21.15.33:0/3687965181 >> v2:172.21.15.33:3300/0 conn(0x7f60240b1940 0x7f60240afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7f9c6165a640 1 -- 172.21.15.33:0/2193846304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09c690 msgr2=0x7f9c5c09caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7f9c6165a640 1 --2- 172.21.15.33:0/2193846304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09c690 0x7f9c5c09caa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c440097a0 tx=0x7f9c4402a0f0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7f602914c640 1 -- 172.21.15.33:0/3687965181 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209967629 0 0) 0x7f6020001040 con 0x7f602406f990 2024-04-25T15:20:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7f602a14e640 1 -- 172.21.15.33:0/3687965181 >> v1:172.21.15.155:6789/0 conn(0x7f602406f2d0 legacy=0x7f60240b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7f602a14e640 1 -- 172.21.15.33:0/3687965181 >> v1:172.21.15.33:6789/0 conn(0x7f602406f990 legacy=0x7f6024147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7f602a14e640 1 -- 172.21.15.33:0/3687965181 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60240b0de0 con 0x7f60240b1940 2024-04-25T15:20:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7faae146f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc140430 0x7faadc0b8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561573746 0 0) 0x7fdd9c149cb0 con 0x7fdd9c0b8190 2024-04-25T15:20:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd84003520 con 0x7fdd9c0b8190 2024-04-25T15:20:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1762384343 0 0) 0x7fdd84003520 con 0x7fdd9c0b8190 2024-04-25T15:20:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 >> v2:172.21.15.155:3300/0 conn(0x7fdd9c0b7d80 msgr2=0x7fdd9c0b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7fdd9959a640 1 --2- 172.21.15.33:0/3062865434 >> v2:172.21.15.155:3300/0 conn(0x7fdd9c0b7d80 0x7fdd9c0b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.295+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 >> v2:172.21.15.33:3300/0 conn(0x7fdd9c0bc430 msgr2=0x7fdd9c146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 --2- 172.21.15.33:0/3062865434 >> v2:172.21.15.33:3300/0 conn(0x7fdd9c0bc430 0x7fdd9c146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9c149f90 con 0x7fdd9c0b8190 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7fdd940019f0 con 0x7fdd9c0b8190 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 >> v1:172.21.15.33:6789/0 conn(0x7fdd9c0b8190 legacy=0x7fdd9c072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd84003a00 0x7fdd84003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd84004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd840051c0 0x7fdd8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c149a60 con 0x7fdd84004800 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c0b31d0 con 0x7fdd84003a00 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd840105f0 con 0x7fdd840051c0 2024-04-25T15:20:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd9a59c640 1 --2- 172.21.15.33:0/3062865434 >> v2:172.21.15.33:3300/0 conn(0x7fdd9c0bc430 0x7fdd9c146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd99d9b640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd84004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd9ad9d640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd840051c0 0x7fdd8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7f602a14e640 1 --2- 172.21.15.33:0/3687965181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60240b1940 0x7f60240afdb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c02a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbe2c9f29cf473d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd9a59c640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd84003a00 0x7fdd84003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7f602914c640 1 -- 172.21.15.33:0/3687965181 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c007740 con 0x7f60240b1940 2024-04-25T15:20:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd99d9b640 1 -- 172.21.15.33:0/3062865434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd840051c0 msgr2=0x7fdd8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7f602914c640 1 -- 172.21.15.33:0/3687965181 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c0078e0 con 0x7f60240b1940 2024-04-25T15:20:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd99d9b640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd840051c0 0x7fdd8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7f602914c640 1 -- 172.21.15.33:0/3687965181 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c007cb0 con 0x7f60240b1940 2024-04-25T15:20:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd99d9b640 1 -- 172.21.15.33:0/3062865434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd84003a00 msgr2=0x7fdd84003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7faae146f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faadc0b7750 0x7faadc146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7faae146f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faadc146750 0x7faadc072190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7faae146f640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7faadc14cb10 con 0x7faadc0b7750 2024-04-25T15:20:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7faae146f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7faadc0b60e0 con 0x7faadc146750 2024-04-25T15:20:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.296+0000 7faae146f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faadc0b63c0 con 0x7faadc140430 2024-04-25T15:20:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd99d9b640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd84003a00 0x7fdd84003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7faadb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faadc0b7750 0x7faadc146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7faadb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faadc0b7750 0x7faadc146210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51406/0 (socket says 172.21.15.33:51406) 2024-04-25T15:20:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7faadb7fe640 1 -- 172.21.15.33:0/2810058409 learned_addr learned my addr 172.21.15.33:0/2810058409 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd99d9b640 1 -- 172.21.15.33:0/3062865434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd84003520 con 0x7fdd84004800 2024-04-25T15:20:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.297+0000 7fdd9ad9d640 1 -- 172.21.15.33:0/3062865434 reap_dead start 2024-04-25T15:20:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7fdd99d9b640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd84004c10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000ba30 tx=0x7fdd84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c6649be8d6a60b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90030070 con 0x7fdd84004800 2024-04-25T15:20:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.298+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9002ad70 con 0x7fdd84004800 2024-04-25T15:20:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f9c6165a640 1 -- 172.21.15.33:0/2193846304 shutdown_connections 2024-04-25T15:20:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f9c6165a640 1 --2- 172.21.15.33:0/2193846304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09c690 0x7f9c5c09caa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f9c6165a640 1 --2- 172.21.15.33:0/2193846304 >> v2:172.21.15.33:3300/0 conn(0x7f9c5c14d130 0x7f9c5c0a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f9c6165a640 1 -- 172.21.15.33:0/2193846304 >> 172.21.15.33:0/2193846304 conn(0x7f9c5c0bb5f0 msgr2=0x7f9c5c0bba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7fdd9959a640 1 -- 172.21.15.33:0/3062865434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000b600 con 0x7fdd84004800 2024-04-25T15:20:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f9c6165a640 1 -- 172.21.15.33:0/2193846304 shutdown_connections 2024-04-25T15:20:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f9c6165a640 1 -- 172.21.15.33:0/2193846304 wait complete. 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f602c3b2640 1 -- 172.21.15.33:0/3687965181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60240b1940 msgr2=0x7f60240afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f602c3b2640 1 --2- 172.21.15.33:0/3687965181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60240b1940 0x7f60240afdb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c02a580 comp rx=0 tx=0).stop 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f602c3b2640 1 -- 172.21.15.33:0/3687965181 shutdown_connections 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f602c3b2640 1 --2- 172.21.15.33:0/3687965181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60240b1940 0x7f60240afdb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f602c3b2640 1 -- 172.21.15.33:0/3687965181 >> 172.21.15.33:0/3687965181 conn(0x7f602406e5d0 msgr2=0x7f602406e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7f602c3b2640 1 -- 172.21.15.33:0/3687965181 shutdown_connections 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7faadb7fe640 1 -- 172.21.15.33:0/2810058409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc140430 msgr2=0x7faadc0b8850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7faadb7fe640 1 --2- 172.21.15.33:0/2810058409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc140430 0x7faadc0b8850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7faadb7fe640 1 -- 172.21.15.33:0/2810058409 >> v2:172.21.15.155:3300/0 conn(0x7faadc146750 msgr2=0x7faadc072190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T15:20:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7faadb7fe640 1 --2- 172.21.15.33:0/2810058409 >> v2:172.21.15.155:3300/0 conn(0x7faadc146750 0x7faadc072190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.299+0000 7faadb7fe640 1 -- 172.21.15.33:0/2810058409 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faadc0b66a0 con 0x7faadc0b7750 2024-04-25T15:20:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7fdda0cee640 1 -- 172.21.15.33:0/3062865434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 msgr2=0x7fdd84004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7fdda0cee640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd84004c10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000ba30 tx=0x7fdd84005830 comp rx=0 tx=0).stop 2024-04-25T15:20:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7f602c3b2640 1 -- 172.21.15.33:0/3687965181 wait complete. 2024-04-25T15:20:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7faadb7fe640 1 --2- 172.21.15.33:0/2810058409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faadc0b7750 0x7faadc146210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faadc06e860 tx=0x7faacc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da1258386c98fbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7fdda0cee640 1 -- 172.21.15.33:0/3062865434 shutdown_connections 2024-04-25T15:20:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7fdda0cee640 1 --2- 172.21.15.33:0/3062865434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd84004c10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7fdda0cee640 1 -- 172.21.15.33:0/3062865434 >> 172.21.15.33:0/3062865434 conn(0x7fdd9c06dd00 msgr2=0x7fdd9c0bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7fdda0cee640 1 -- 172.21.15.33:0/3062865434 shutdown_connections 2024-04-25T15:20:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.300+0000 7fdda0cee640 1 -- 172.21.15.33:0/3062865434 wait complete. 2024-04-25T15:20:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.301+0000 7faadaffd640 1 -- 172.21.15.33:0/2810058409 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc037070 con 0x7faadc0b7750 2024-04-25T15:20:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.301+0000 7faadaffd640 1 -- 172.21.15.33:0/2810058409 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faacc032440 con 0x7faadc0b7750 2024-04-25T15:20:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.301+0000 7faadaffd640 1 -- 172.21.15.33:0/2810058409 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc032810 con 0x7faadc0b7750 2024-04-25T15:20:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7faae146f640 1 -- 172.21.15.33:0/2810058409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faadc0b7750 msgr2=0x7faadc146210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7faae146f640 1 --2- 172.21.15.33:0/2810058409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faadc0b7750 0x7faadc146210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faadc06e860 tx=0x7faacc02a1c0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7f602c3b2640 1 Processor -- start 2024-04-25T15:20:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7f602c3b2640 1 -- start start 2024-04-25T15:20:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.301+0000 7f9c6165a640 1 Processor -- start 2024-04-25T15:20:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.301+0000 7f9c6165a640 1 -- start start 2024-04-25T15:20:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7faae146f640 1 -- 172.21.15.33:0/2810058409 shutdown_connections 2024-04-25T15:20:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7faae146f640 1 --2- 172.21.15.33:0/2810058409 >> v2:172.21.15.155:3300/0 conn(0x7faadc146750 0x7faadc072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c6165a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5c09c690 0x7f9c5c0b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7faae146f640 1 --2- 172.21.15.33:0/2810058409 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faadc0b7750 0x7faadc146210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7faae146f640 1 --2- 172.21.15.33:0/2810058409 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc140430 0x7faadc0b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.302+0000 7faae146f640 1 -- 172.21.15.33:0/2810058409 >> 172.21.15.33:0/2810058409 conn(0x7faadc06dec0 msgr2=0x7faadc0b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c6165a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09da70 0x7f9c5c1e3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7fdda0cee640 1 Processor -- start 2024-04-25T15:20:50.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c6165a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5c14d130 0x7f9c5c0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c6165a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c153fe0 con 0x7f9c5c14d130 2024-04-25T15:20:50.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c6165a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c0a1220 con 0x7f9c5c09c690 2024-04-25T15:20:50.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c6165a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5c154160 con 0x7f9c5c09da70 2024-04-25T15:20:50.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c5affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5c09c690 0x7f9c5c0b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c5affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5c09c690 0x7f9c5c0b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51228/0 (socket says 172.21.15.33:51228) 2024-04-25T15:20:50.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7faae146f640 1 -- 172.21.15.33:0/2810058409 shutdown_connections 2024-04-25T15:20:50.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c53fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09da70 0x7f9c5c1e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c5affd640 1 -- 172.21.15.33:0/4013844874 learned_addr learned my addr 172.21.15.33:0/4013844874 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.324 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c5b7fe640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5c14d130 0x7f9c5c0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7faae146f640 1 -- 172.21.15.33:0/2810058409 wait complete. 2024-04-25T15:20:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c53fff640 1 -- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5c09c690 msgr2=0x7f9c5c0b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c53fff640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5c09c690 0x7f9c5c0b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c53fff640 1 -- 172.21.15.33:0/4013844874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5c14d130 msgr2=0x7f9c5c0b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c53fff640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5c14d130 0x7f9c5c0b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.303+0000 7f9c53fff640 1 -- 172.21.15.33:0/4013844874 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5c1e3d70 con 0x7f9c5c09da70 2024-04-25T15:20:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f9c53fff640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09da70 0x7f9c5c1e3830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c14a730 tx=0x7f9c440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f602c3b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f602406f2d0 0x7f602413e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f602c3b2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f602406f990 0x7f602414a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f602a14e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f602406f2d0 0x7f602413e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f9c537fe640 1 -- 172.21.15.33:0/4013844874 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44041020 con 0x7f9c5c09da70 2024-04-25T15:20:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f602a14e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f602406f2d0 0x7f602413e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51420/0 (socket says 172.21.15.33:51420) 2024-04-25T15:20:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f9c537fe640 1 -- 172.21.15.33:0/4013844874 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4403d670 con 0x7f9c5c09da70 2024-04-25T15:20:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5c145f70 con 0x7f9c5c09da70 2024-04-25T15:20:50.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c5c146490 con 0x7f9c5c09da70 2024-04-25T15:20:50.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f602c3b2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1940 0x7f60241ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.328 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f9c537fe640 1 -- 172.21.15.33:0/4013844874 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44037040 con 0x7f9c5c09da70 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.304+0000 7f602994d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f602406f990 0x7f602414a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602994d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f602406f990 0x7f602414a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:45764/0 (socket says 172.21.15.33:45764) 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6024159470 con 0x7f602406f2d0 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f602406f6e0 con 0x7f60240b1940 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60241595f0 con 0x7f602406f990 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602a14e640 1 -- 172.21.15.33:0/1168943604 learned_addr learned my addr 172.21.15.33:0/1168943604 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602a94f640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1940 0x7f60241ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602a14e640 1 -- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f602406f990 msgr2=0x7f602414a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602a14e640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f602406f990 0x7f602414a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602a14e640 1 -- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1940 msgr2=0x7f60241ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.329 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602a14e640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1940 0x7f60241ef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7f602a14e640 1 -- 172.21.15.33:0/1168943604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602413e750 con 0x7f602406f2d0 2024-04-25T15:20:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.306+0000 7f602a14e640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f602406f2d0 0x7f602413e210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.306+0000 7faae146f640 1 Processor -- start 2024-04-25T15:20:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.305+0000 7fdda0cee640 1 -- start start 2024-04-25T15:20:50.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.306+0000 7f601affd640 1 -- 172.21.15.33:0/1168943604 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c040070 con 0x7f602406f2d0 2024-04-25T15:20:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.306+0000 7f601affd640 1 -- 172.21.15.33:0/1168943604 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c031c40 con 0x7f602406f2d0 2024-04-25T15:20:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.306+0000 7f601affd640 1 -- 172.21.15.33:0/1168943604 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c003990 con 0x7f602406f2d0 2024-04-25T15:20:50.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7faae146f640 1 -- start start 2024-04-25T15:20:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.306+0000 7fdda0cee640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd9c0ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.306+0000 7fdda0cee640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9c0ab7d0 0x7fdd9c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.306+0000 7fdda0cee640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd9c0b2430 0x7fdd9c1de130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdda0cee640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c14a790 con 0x7fdd84004800 2024-04-25T15:20:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdda0cee640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c0bc840 con 0x7fdd9c0b2430 2024-04-25T15:20:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdda0cee640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9c14a910 con 0x7fdd9c0ab7d0 2024-04-25T15:20:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd9c0ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd99d9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9c0ab7d0 0x7fdd9c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60240b50c0 con 0x7f602406f2d0 2024-04-25T15:20:50.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602413f230 con 0x7f602406f2d0 2024-04-25T15:20:50.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.308+0000 7f9c537fe640 1 -- 172.21.15.33:0/4013844874 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9c44044020 con 0x7f9c5c09da70 2024-04-25T15:20:50.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.309+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60240764e0 con 0x7f602406f2d0 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd9c0ac620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51424/0 (socket says 172.21.15.33:51424) 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9a59c640 1 -- 172.21.15.33:0/3310447101 learned_addr learned my addr 172.21.15.33:0/3310447101 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9ad9d640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd9c0b2430 0x7fdd9c1de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9a59c640 1 -- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9c0ab7d0 msgr2=0x7fdd9c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9a59c640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9c0ab7d0 0x7fdd9c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9a59c640 1 -- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd9c0b2430 msgr2=0x7fdd9c1de130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9a59c640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd9c0b2430 0x7fdd9c1de130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.307+0000 7fdd9a59c640 1 -- 172.21.15.33:0/3310447101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9c0b2840 con 0x7fdd84004800 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.309+0000 7fdd9a59c640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd9c0ac620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c011a00 tx=0x7fdd8c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.309+0000 7fdd8affd640 1 -- 172.21.15.33:0/3310447101 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00fbb0 con 0x7fdd84004800 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.310+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd9c0ad900 con 0x7fdd84004800 2024-04-25T15:20:50.335 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.310+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9c0abef0 con 0x7fdd84004800 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.309+0000 7f9c537fe640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9c3c074580 0x7f9c3c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.309+0000 7f9c537fe640 1 -- 172.21.15.33:0/4013844874 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9c440b53c0 con 0x7f9c5c09da70 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.310+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c40005290 con 0x7f9c5c09da70 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7f9c5affd640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9c3c074580 0x7f9c3c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7faae146f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc0b7750 0x7faadc1e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7faae146f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faadc140430 0x7faadc1e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7faae146f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faadc146750 0x7faadc144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7faae146f640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faadc0b8d90 con 0x7faadc146750 2024-04-25T15:20:50.336 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7faae146f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faadc0b59f0 con 0x7faadc140430 2024-04-25T15:20:50.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7faae146f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faadc0b8f10 con 0x7faadc0b7750 2024-04-25T15:20:50.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7faadb7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faadc140430 0x7faadc1e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadb7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faadc140430 0x7faadc1e5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51266/0 (socket says 172.21.15.33:51266) 2024-04-25T15:20:50.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadb7fe640 1 -- 172.21.15.33:0/397773306 learned_addr learned my addr 172.21.15.33:0/397773306 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadbfff640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc0b7750 0x7faadc1e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.310+0000 7f601affd640 1 -- 172.21.15.33:0/1168943604 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f601c039040 con 0x7f602406f2d0 2024-04-25T15:20:50.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7f601affd640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6008074500 0x7f6008076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7f601affd640 1 -- 172.21.15.33:0/1168943604 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f601c0b6710 con 0x7f602406f2d0 2024-04-25T15:20:50.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7f602994d640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6008074500 0x7f6008076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadb7fe640 1 -- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc0b7750 msgr2=0x7faadc1e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadb7fe640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc0b7750 0x7faadc1e7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadb7fe640 1 -- 172.21.15.33:0/397773306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faadc146750 msgr2=0x7faadc144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadb7fe640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faadc146750 0x7faadc144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadb7fe640 1 -- 172.21.15.33:0/397773306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faadc1e5f50 con 0x7faadc140430 2024-04-25T15:20:50.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7faadbfff640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc0b7750 0x7faadc1e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:50.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.311+0000 7fdd8affd640 1 -- 172.21.15.33:0/3310447101 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00fd50 con 0x7fdd84004800 2024-04-25T15:20:50.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7fdd8affd640 1 -- 172.21.15.33:0/3310447101 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c014660 con 0x7fdd84004800 2024-04-25T15:20:50.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.312+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd80005290 con 0x7fdd84004800 2024-04-25T15:20:50.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.313+0000 7f602994d640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6008074500 0x7f6008076a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f60240a0ef0 tx=0x7f6020007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.313+0000 7faadb7fe640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faadc140430 0x7faadc1e5a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faacc009990 tx=0x7faacc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.314+0000 7faad8ff9640 1 -- 172.21.15.33:0/397773306 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc041070 con 0x7faadc140430 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.314+0000 7faad8ff9640 1 -- 172.21.15.33:0/397773306 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faacc03c930 con 0x7faadc140430 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.314+0000 7faad8ff9640 1 -- 172.21.15.33:0/397773306 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc037040 con 0x7faadc140430 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.314+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faadc145de0 con 0x7faadc140430 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.314+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faadc145130 con 0x7faadc140430 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.314+0000 7fdd8affd640 1 -- 172.21.15.33:0/3310447101 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdd8c012040 con 0x7fdd84004800 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.314+0000 7fdd8affd640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdd7c074580 0x7fdd7c076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.315+0000 7fdd8affd640 1 -- 172.21.15.33:0/3310447101 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdd8c095f10 con 0x7fdd84004800 2024-04-25T15:20:50.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.315+0000 7fdd99d9b640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdd7c074580 0x7fdd7c076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.315+0000 7f9c537fe640 1 -- 172.21.15.33:0/4013844874 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9c4407f4e0 con 0x7f9c5c09da70 2024-04-25T15:20:50.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.315+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faadc1457f0 con 0x7faadc140430 2024-04-25T15:20:50.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.316+0000 7f9c5affd640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9c3c074580 0x7f9c3c076a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c006a90 tx=0x7f9c4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.316+0000 7faad8ff9640 1 -- 172.21.15.33:0/397773306 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faacc044070 con 0x7faadc140430 2024-04-25T15:20:50.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.317+0000 7fdd99d9b640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdd7c074580 0x7fdd7c076a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000ba00 tx=0x7fdd90030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.317+0000 7faad8ff9640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faac80744b0 0x7faac80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.317+0000 7faad8ff9640 1 -- 172.21.15.33:0/397773306 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faacc0b5db0 con 0x7faadc140430 2024-04-25T15:20:50.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.317+0000 7faadbfff640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faac80744b0 0x7faac80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.318+0000 7faadbfff640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faac80744b0 0x7faac80769c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faad0006fd0 tx=0x7faad0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.321+0000 7f601affd640 1 -- 172.21.15.33:0/1168943604 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f601c081010 con 0x7f602406f2d0 2024-04-25T15:20:50.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.322+0000 7faad8ff9640 1 -- 172.21.15.33:0/397773306 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faadc1457f0 con 0x7faadc140430 2024-04-25T15:20:50.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.331+0000 7fdd8affd640 1 -- 172.21.15.33:0/3310447101 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd8c02b020 con 0x7fdd84004800 2024-04-25T15:20:50.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.687+0000 7f8d4ec76640 1 -- 172.21.15.33:0/2395309301 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8d30005580 con 0x7f8d400c9a10 2024-04-25T15:20:50.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.688+0000 7f8d3e7fc640 1 -- 172.21.15.33:0/2395309301 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d480ca0d0 con 0x7f8d400c9a10 2024-04-25T15:20:50.690 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.691+0000 7f8d2bfff640 1 -- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8d2c074580 msgr2=0x7f8d2c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.691+0000 7f8d2bfff640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8d2c074580 0x7f8d2c076a90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8d44004e40 tx=0x7f8d44007eb0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 -- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400c9a10 msgr2=0x7f8d400c0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400c9a10 0x7f8d400c0320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d480514f0 tx=0x7f8d4806eb20 comp rx=0 tx=0).stop 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 -- 172.21.15.33:0/2395309301 shutdown_connections 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8d2c074580 0x7f8d2c076a90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d400c9a10 0x7f8d400c0320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d400383e0 0x7f8d400c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 --2- 172.21.15.33:0/2395309301 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d40035b50 0x7f8d4003de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 -- 172.21.15.33:0/2395309301 >> 172.21.15.33:0/2395309301 conn(0x7f8d4003f160 msgr2=0x7f8d4003bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.692+0000 7f8d2bfff640 1 -- 172.21.15.33:0/2395309301 shutdown_connections 2024-04-25T15:20:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.693+0000 7f8d2bfff640 1 -- 172.21.15.33:0/2395309301 wait complete. 2024-04-25T15:20:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.699+0000 7fb8042f2640 1 -- 172.21.15.33:0/1575937650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb7fc148ec0 con 0x7fb7fc0b8190 2024-04-25T15:20:50.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.700+0000 7fb7faffd640 1 -- 172.21.15.33:0/1575937650 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7ec088550 con 0x7fb7fc0b8190 2024-04-25T15:20:50.701 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-04-25T15:20:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.704+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9fe813f370 con 0x7f9fe80b4130 2024-04-25T15:20:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.704+0000 7fb7f8ff9640 1 -- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb7e80745b0 msgr2=0x7fb7e8076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.704+0000 7fb7f8ff9640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb7e80745b0 0x7fb7e8076ac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4006fd0 tx=0x7fb7f4009060 comp rx=0 tx=0).stop 2024-04-25T15:20:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.704+0000 7fb7f8ff9640 1 -- 172.21.15.33:0/1575937650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b8190 msgr2=0x7fb7fc0ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.704+0000 7fb7f8ff9640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b8190 0x7fb7fc0ac2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec034040 tx=0x7fb7ec004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.704+0000 7f9fcffff640 1 -- 172.21.15.33:0/2872531302 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9fd8067130 con 0x7f9fe80b4130 2024-04-25T15:20:50.706 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2024-04-25T15:20:50.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.705+0000 7fb7f8ff9640 1 -- 172.21.15.33:0/1575937650 shutdown_connections 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.705+0000 7fb7f8ff9640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fb7e80745b0 0x7fb7e8076ac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.705+0000 7fb7f8ff9640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7fc0bc430 0x7fb7fc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.705+0000 7fb7f8ff9640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7fc0b8190 0x7fb7fc0ac2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.705+0000 7fb7f8ff9640 1 --2- 172.21.15.33:0/1575937650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc0b7d80 0x7fb7fc0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.705+0000 7fb7f8ff9640 1 -- 172.21.15.33:0/1575937650 >> 172.21.15.33:0/1575937650 conn(0x7fb7fc06dd00 msgr2=0x7fb7fc1492f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.705+0000 7fb7f8ff9640 1 -- 172.21.15.33:0/1575937650 shutdown_connections 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.705+0000 7fb7f8ff9640 1 -- 172.21.15.33:0/1575937650 wait complete. 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.706+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fde800764e0 con 0x7fde801df050 2024-04-25T15:20:50.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.706+0000 7fde77fff640 1 -- 172.21.15.33:0/793930436 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde7005ea70 con 0x7fde801df050 2024-04-25T15:20:50.709 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2024-04-25T15:20:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.707+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9fd40744e0 msgr2=0x7f9fd40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9fd40744e0 0x7f9fd40769f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9fe003d000 tx=0x7f9fe0037000 comp rx=0 tx=0).stop 2024-04-25T15:20:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fe80b4130 msgr2=0x7f9fe814a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fe80b4130 0x7f9fe814a510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800c3c0 tx=0x7f9fd800c880 comp rx=0 tx=0).stop 2024-04-25T15:20:50.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 shutdown_connections 2024-04-25T15:20:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9fd40744e0 0x7f9fd40769f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9fe8141500 0x7f9fe813a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fe80b6df0 0x7f9fe81488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 --2- 172.21.15.33:0/2872531302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fe80b4130 0x7f9fe814a510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 >> 172.21.15.33:0/2872531302 conn(0x7f9fe806ce70 msgr2=0x7f9fe8147e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 shutdown_connections 2024-04-25T15:20:50.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.708+0000 7f9fede15640 1 -- 172.21.15.33:0/2872531302 wait complete. 2024-04-25T15:20:50.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.710+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde60074580 msgr2=0x7fde60076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.710+0000 7fde85a49640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde60074580 0x7fde60076a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fde800733b0 tx=0x7fde68030000 comp rx=0 tx=0).stop 2024-04-25T15:20:50.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde801df050 msgr2=0x7fde801db460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde801df050 0x7fde801db460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde7000e460 tx=0x7fde7000e920 comp rx=0 tx=0).stop 2024-04-25T15:20:50.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-25T15:20:50.714 DEBUG:teuthology.parallel:result is None 2024-04-25T15:20:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 shutdown_connections 2024-04-25T15:20:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde60074580 0x7fde60076a90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80148cd0 0x7fde801db9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde801df050 0x7fde801db460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 --2- 172.21.15.33:0/793930436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde801488c0 0x7fde801deb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 >> 172.21.15.33:0/793930436 conn(0x7fde800ba8b0 msgr2=0x7fde800b8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 shutdown_connections 2024-04-25T15:20:50.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.711+0000 7fde85a49640 1 -- 172.21.15.33:0/793930436 wait complete. 2024-04-25T15:20:50.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-04-25T15:20:50.729 DEBUG:teuthology.parallel:result is None 2024-04-25T15:20:50.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-04-25T15:20:50.729 DEBUG:teuthology.parallel:result is None 2024-04-25T15:20:50.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-04-25T15:20:50.732 DEBUG:teuthology.parallel:result is None 2024-04-25T15:20:50.736 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.735+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdd80005850 con 0x7fdd84004800 2024-04-25T15:20:50.737 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.736+0000 7fdd8affd640 1 -- 172.21.15.33:0/3310447101 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdd8c019030 con 0x7fdd84004800 2024-04-25T15:20:50.737 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdd7c074580 msgr2=0x7fdd7c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdd7c074580 0x7fdd7c076a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000ba00 tx=0x7fdd90030000 comp rx=0 tx=0).stop 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 msgr2=0x7fdd9c0ac620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd9c0ac620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c011a00 tx=0x7fdd8c011ec0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 shutdown_connections 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdd7c074580 0x7fdd7c076a90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd9c0b2430 0x7fdd9c1de130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd9c0ab7d0 0x7fdd9c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 --2- 172.21.15.33:0/3310447101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd84004800 0x7fdd9c0ac620 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 >> 172.21.15.33:0/3310447101 conn(0x7fdd9c06dd00 msgr2=0x7fdd9c075ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 shutdown_connections 2024-04-25T15:20:50.741 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.738+0000 7fdda0cee640 1 -- 172.21.15.33:0/3310447101 wait complete. 2024-04-25T15:20:50.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.742+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9c40005580 con 0x7f9c5c09da70 2024-04-25T15:20:50.743 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.742+0000 7f9c537fe640 1 -- 172.21.15.33:0/4013844874 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9c440837e0 con 0x7f9c5c09da70 2024-04-25T15:20:50.744 INFO:teuthology.orchestra.run.smithi033.stdout:55834574857 2024-04-25T15:20:50.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9c3c074580 msgr2=0x7f9c3c076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9c3c074580 0x7f9c3c076a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c006a90 tx=0x7f9c4c008040 comp rx=0 tx=0).stop 2024-04-25T15:20:50.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09da70 msgr2=0x7f9c5c1e3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09da70 0x7f9c5c1e3830 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c14a730 tx=0x7f9c440046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 shutdown_connections 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f9c3c074580 0x7f9c3c076a90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5c14d130 0x7f9c5c0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c5c09da70 0x7f9c5c1e3830 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 --2- 172.21.15.33:0/4013844874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c5c09c690 0x7f9c5c0b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 >> 172.21.15.33:0/4013844874 conn(0x7f9c5c0bb5f0 msgr2=0x7f9c5c09de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 shutdown_connections 2024-04-25T15:20:50.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.746+0000 7f9c6165a640 1 -- 172.21.15.33:0/4013844874 wait complete. 2024-04-25T15:20:50.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-04-25T15:20:50.753 DEBUG:teuthology.parallel:result is None 2024-04-25T15:20:50.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-04-25T15:20:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.757+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7faadc0b57e0 con 0x7faadc140430 2024-04-25T15:20:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.758+0000 7faad8ff9640 1 -- 172.21.15.33:0/397773306 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faadc0b57e0 con 0x7faadc140430 2024-04-25T15:20:50.759 DEBUG:teuthology.parallel:result is None 2024-04-25T15:20:50.760 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faac80744b0 msgr2=0x7faac80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faac80744b0 0x7faac80769c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faad0006fd0 tx=0x7faad0008040 comp rx=0 tx=0).stop 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faadc140430 msgr2=0x7faadc1e5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faadc140430 0x7faadc1e5a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faacc009990 tx=0x7faacc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 shutdown_connections 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faac80744b0 0x7faac80769c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faadc146750 0x7faadc144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faadc140430 0x7faadc1e5a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 --2- 172.21.15.33:0/397773306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faadc0b7750 0x7faadc1e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 >> 172.21.15.33:0/397773306 conn(0x7faadc06dec0 msgr2=0x7faadc0b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 shutdown_connections 2024-04-25T15:20:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.760+0000 7faae146f640 1 -- 172.21.15.33:0/397773306 wait complete. 2024-04-25T15:20:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.763+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f60240b5470 con 0x7f602406f2d0 2024-04-25T15:20:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.763+0000 7f601affd640 1 -- 172.21.15.33:0/1168943604 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f601c080910 con 0x7f602406f2d0 2024-04-25T15:20:50.765 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2024-04-25T15:20:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6008074500 msgr2=0x7f6008076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6008074500 0x7f6008076a10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f60240a0ef0 tx=0x7f6020007a90 comp rx=0 tx=0).stop 2024-04-25T15:20:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f602406f2d0 msgr2=0x7f602413e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f602406f2d0 0x7f602413e210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f601c009d90 tx=0x7f601c004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 shutdown_connections 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f6008074500 0x7f6008076a10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60240b1940 0x7f60241ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f602406f990 0x7f602414a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 --2- 172.21.15.33:0/1168943604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f602406f2d0 0x7f602413e210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 >> 172.21.15.33:0/1168943604 conn(0x7f602406e5d0 msgr2=0x7f60240b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 shutdown_connections 2024-04-25T15:20:50.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.767+0000 7f602c3b2640 1 -- 172.21.15.33:0/1168943604 wait complete. 2024-04-25T15:20:50.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-04-25T15:20:50.775 DEBUG:teuthology.parallel:result is None 2024-04-25T15:20:50.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-25T15:20:50.780 DEBUG:teuthology.parallel:result is None 2024-04-25T15:20:50.780 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T15:20:50.780 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:20:50.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.931+0000 7f7307830640 1 Processor -- start 2024-04-25T15:20:50.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.931+0000 7f7307830640 1 -- start start 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.932+0000 7f7307830640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f730014a190 0x7f730013f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.932+0000 7f7307830640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 0x7f7300140280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.932+0000 7f7307830640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7300149710 con 0x7f730006d8b0 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.932+0000 7f7307830640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f730006e970 con 0x7f730014a190 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.932+0000 7f7307830640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7300149990 con 0x7f730013fe70 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.932+0000 7f7304dcb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f730014a190 0x7f730013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.932+0000 7f7304dcb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f730014a190 0x7f730013f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51444/0 (socket says 172.21.15.33:51444) 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.932+0000 7f7304dcb640 1 -- 172.21.15.33:0/3312617072 learned_addr learned my addr 172.21.15.33:0/3312617072 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.933+0000 7f7305dcd640 1 --2- 172.21.15.33:0/3312617072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 0x7f7300140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.933+0000 7f7304dcb640 1 -- 172.21.15.33:0/3312617072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 msgr2=0x7f7300140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:50.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.933+0000 7f7304dcb640 1 --2- 172.21.15.33:0/3312617072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 0x7f7300140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.933+0000 7f7304dcb640 1 -- 172.21.15.33:0/3312617072 >> v1:172.21.15.155:6789/0 conn(0x7f730006d8b0 legacy=0x7f730006ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.933+0000 7f7304dcb640 1 -- 172.21.15.33:0/3312617072 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7300149c70 con 0x7f730014a190 2024-04-25T15:20:50.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.933+0000 7f7304dcb640 1 --2- 172.21.15.33:0/3312617072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730014a190 0x7f730013f930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009870 tx=0x7f72f402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e7f0b5e7396e20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f72fffff640 1 -- 172.21.15.33:0/3312617072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4037070 con 0x7f730014a190 2024-04-25T15:20:50.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f72fffff640 1 -- 172.21.15.33:0/3312617072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f4032440 con 0x7f730014a190 2024-04-25T15:20:50.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f72fffff640 1 -- 172.21.15.33:0/3312617072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4032810 con 0x7f730014a190 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f7307830640 1 -- 172.21.15.33:0/3312617072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730014a190 msgr2=0x7f730013f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f7307830640 1 --2- 172.21.15.33:0/3312617072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730014a190 0x7f730013f930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009870 tx=0x7f72f402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f7307830640 1 -- 172.21.15.33:0/3312617072 shutdown_connections 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f7307830640 1 --2- 172.21.15.33:0/3312617072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 0x7f7300140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f7307830640 1 --2- 172.21.15.33:0/3312617072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730014a190 0x7f730013f930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f7307830640 1 -- 172.21.15.33:0/3312617072 >> 172.21.15.33:0/3312617072 conn(0x7f73000bcba0 msgr2=0x7f73000bcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f7307830640 1 -- 172.21.15.33:0/3312617072 shutdown_connections 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.934+0000 7f7307830640 1 -- 172.21.15.33:0/3312617072 wait complete. 2024-04-25T15:20:50.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.936+0000 7f7307830640 1 Processor -- start 2024-04-25T15:20:50.938 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.936+0000 7f7307830640 1 -- start start 2024-04-25T15:20:50.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7307830640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730006d8b0 0x7f7300145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7307830640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 0x7f730014c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7307830640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730014a190 0x7f730013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7307830640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f730014a5a0 con 0x7f730006d8b0 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7307830640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f730006dcc0 con 0x7f730014a190 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7307830640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7300070a50 con 0x7f730013fe70 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f73055cc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730006d8b0 0x7f7300145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f73055cc640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730006d8b0 0x7f7300145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51460/0 (socket says 172.21.15.33:51460) 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f73055cc640 1 -- 172.21.15.33:0/3668096048 learned_addr learned my addr 172.21.15.33:0/3668096048 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7304dcb640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 0x7f730014c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7305dcd640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730014a190 0x7f730013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f73055cc640 1 -- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 msgr2=0x7f730014c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f73055cc640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 0x7f730014c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f73055cc640 1 -- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730014a190 msgr2=0x7f730013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f73055cc640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730014a190 0x7f730013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f73055cc640 1 -- 172.21.15.33:0/3668096048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730014d5f0 con 0x7f730006d8b0 2024-04-25T15:20:50.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.937+0000 7f7305dcd640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730014a190 0x7f730013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:50.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.938+0000 7f73055cc640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730006d8b0 0x7f7300145150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c470 tx=0x7f72f800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.938+0000 7f72fdffb640 1 -- 172.21.15.33:0/3668096048 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80052d0 con 0x7f730006d8b0 2024-04-25T15:20:50.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.938+0000 7f72fdffb640 1 -- 172.21.15.33:0/3668096048 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f8005490 con 0x7f730006d8b0 2024-04-25T15:20:50.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.938+0000 7f72fdffb640 1 -- 172.21.15.33:0/3668096048 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007260 con 0x7f730006d8b0 2024-04-25T15:20:50.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.938+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7300145690 con 0x7f730006d8b0 2024-04-25T15:20:50.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.938+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730014a8d0 con 0x7f730006d8b0 2024-04-25T15:20:50.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.939+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73000764e0 con 0x7f730006d8b0 2024-04-25T15:20:50.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.939+0000 7f72fdffb640 1 -- 172.21.15.33:0/3668096048 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f72f8007400 con 0x7f730006d8b0 2024-04-25T15:20:50.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.940+0000 7f72fdffb640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f72ec0744b0 0x7f72ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:50.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.940+0000 7f72fdffb640 1 -- 172.21.15.33:0/3668096048 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72f8094620 con 0x7f730006d8b0 2024-04-25T15:20:50.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.940+0000 7f7304dcb640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f72ec0744b0 0x7f72ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:50.942 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.941+0000 7f7304dcb640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f72ec0744b0 0x7f72ec0769c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72f4034000 tx=0x7f72f402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:50.946 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:50.945+0000 7f72fdffb640 1 -- 172.21.15.33:0/3668096048 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7300149710 con 0x7f730006d8b0 2024-04-25T15:20:51.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.124+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7300144e70 con 0x7f72ec0744b0 2024-04-25T15:20:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.131+0000 7f72fdffb640 1 -- 172.21.15.33:0/3668096048 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7f72f4032730 con 0x7f72ec0744b0 2024-04-25T15:20:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:51.137 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f72ec0744b0 msgr2=0x7f72ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f72ec0744b0 0x7f72ec0769c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72f4034000 tx=0x7f72f402e000 comp rx=0 tx=0).stop 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730006d8b0 msgr2=0x7f7300145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730006d8b0 0x7f7300145150 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c470 tx=0x7f72f800c930 comp rx=0 tx=0).stop 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 shutdown_connections 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f72ec0744b0 0x7f72ec0769c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f730014a190 0x7f730013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f730013fe70 0x7f730014c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 --2- 172.21.15.33:0/3668096048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f730006d8b0 0x7f7300145150 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 >> 172.21.15.33:0/3668096048 conn(0x7f73000bcba0 msgr2=0x7f7300147b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 shutdown_connections 2024-04-25T15:20:51.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.134+0000 7f7307830640 1 -- 172.21.15.33:0/3668096048 wait complete. 2024-04-25T15:20:51.146 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T15:20:49.707031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002273"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405573+0000","last_change":"2024-04-25T15:20:42.418715+0000","last_active":"2024-04-25T15:20:43.405573+0000","last_peered":"2024-04-25T15:20:43.405573+0000","last_clean":"2024-04-25T15:20:43.405573+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:20:43.405573+0000","last_undegraded":"2024-04-25T15:20:43.405573+0000","last_fullsized":"2024-04-25T15:20:43.405573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.236522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401337+0000","last_change":"2024-04-25T15:20:42.417722+0000","last_active":"2024-04-25T15:20:43.401337+0000","last_peered":"2024-04-25T15:20:43.401337+0000","last_clean":"2024-04-25T15:20:43.401337+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:20:43.401337+0000","last_undegraded":"2024-04-25T15:20:43.401337+0000","last_fullsized":"2024-04-25T15:20:43.401337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616831+0000","last_change":"2024-04-25T15:20:42.414889+0000","last_active":"2024-04-25T15:20:43.616831+0000","last_peered":"2024-04-25T15:20:43.616831+0000","last_clean":"2024-04-25T15:20:43.616831+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:20:43.616831+0000","last_undegraded":"2024-04-25T15:20:43.616831+0000","last_fullsized":"2024-04-25T15:20:43.616831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616592+0000","last_change":"2024-04-25T15:20:42.423112+0000","last_active":"2024-04-25T15:20:43.616592+0000","last_peered":"2024-04-25T15:20:43.616592+0000","last_clean":"2024-04-25T15:20:43.616592+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:20:43.616592+0000","last_undegraded":"2024-04-25T15:20:43.616592+0000","last_fullsized":"2024-04-25T15:20:43.616592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.236522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406049+0000","last_change":"2024-04-25T15:20:42.417398+0000","last_active":"2024-04-25T15:20:43.406049+0000","last_peered":"2024-04-25T15:20:43.406049+0000","last_clean":"2024-04-25T15:20:43.406049+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:20:43.406049+0000","last_undegraded":"2024-04-25T15:20:43.406049+0000","last_fullsized":"2024-04-25T15:20:43.406049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:26.290972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616266+0000","last_change":"2024-04-25T15:20:42.424408+0000","last_active":"2024-04-25T15:20:43.616266+0000","last_peered":"2024-04-25T15:20:43.616266+0000","last_clean":"2024-04-25T15:20:43.616266+0000","last_became_active":"2024-04-25T15:20:42.423560+0000","last_became_peered":"2024-04-25T15:20:42.423560+0000","last_unstale":"2024-04-25T15:20:43.616266+0000","last_undegraded":"2024-04-25T15:20:43.616266+0000","last_fullsized":"2024-04-25T15:20:43.616266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404956+0000","last_change":"2024-04-25T15:20:42.413800+0000","last_active":"2024-04-25T15:20:43.404956+0000","last_peered":"2024-04-25T15:20:43.404956+0000","last_clean":"2024-04-25T15:20:43.404956+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:20:43.404956+0000","last_undegraded":"2024-04-25T15:20:43.404956+0000","last_fullsized":"2024-04-25T15:20:43.404956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615647+0000","last_change":"2024-04-25T15:20:42.431896+0000","last_active":"2024-04-25T15:20:43.615647+0000","last_peered":"2024-04-25T15:20:43.615647+0000","last_clean":"2024-04-25T15:20:43.615647+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:20:43.615647+0000","last_undegraded":"2024-04-25T15:20:43.615647+0000","last_fullsized":"2024-04-25T15:20:43.615647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405749+0000","last_change":"2024-04-25T15:20:42.420423+0000","last_active":"2024-04-25T15:20:43.405749+0000","last_peered":"2024-04-25T15:20:43.405749+0000","last_clean":"2024-04-25T15:20:43.405749+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:20:43.405749+0000","last_undegraded":"2024-04-25T15:20:43.405749+0000","last_fullsized":"2024-04-25T15:20:43.405749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:41.305637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616917+0000","last_change":"2024-04-25T15:20:42.428177+0000","last_active":"2024-04-25T15:20:43.616917+0000","last_peered":"2024-04-25T15:20:43.616917+0000","last_clean":"2024-04-25T15:20:43.616917+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:20:43.616917+0000","last_undegraded":"2024-04-25T15:20:43.616917+0000","last_fullsized":"2024-04-25T15:20:43.616917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616285+0000","last_change":"2024-04-25T15:20:42.420688+0000","last_active":"2024-04-25T15:20:43.616285+0000","last_peered":"2024-04-25T15:20:43.616285+0000","last_clean":"2024-04-25T15:20:43.616285+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:20:43.616285+0000","last_undegraded":"2024-04-25T15:20:43.616285+0000","last_fullsized":"2024-04-25T15:20:43.616285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405959+0000","last_change":"2024-04-25T15:20:42.412698+0000","last_active":"2024-04-25T15:20:43.405959+0000","last_peered":"2024-04-25T15:20:43.405959+0000","last_clean":"2024-04-25T15:20:43.405959+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:20:43.405959+0000","last_undegraded":"2024-04-25T15:20:43.405959+0000","last_fullsized":"2024-04-25T15:20:43.405959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:21.373351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616977+0000","last_change":"2024-04-25T15:20:42.427925+0000","last_active":"2024-04-25T15:20:43.616977+0000","last_peered":"2024-04-25T15:20:43.616977+0000","last_clean":"2024-04-25T15:20:43.616977+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:20:43.616977+0000","last_undegraded":"2024-04-25T15:20:43.616977+0000","last_fullsized":"2024-04-25T15:20:43.616977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616364+0000","last_change":"2024-04-25T15:20:42.417743+0000","last_active":"2024-04-25T15:20:43.616364+0000","last_peered":"2024-04-25T15:20:43.616364+0000","last_clean":"2024-04-25T15:20:43.616364+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:20:43.616364+0000","last_undegraded":"2024-04-25T15:20:43.616364+0000","last_fullsized":"2024-04-25T15:20:43.616364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:45.392358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400983+0000","last_change":"2024-04-25T15:20:42.415903+0000","last_active":"2024-04-25T15:20:43.400983+0000","last_peered":"2024-04-25T15:20:43.400983+0000","last_clean":"2024-04-25T15:20:43.400983+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:20:43.400983+0000","last_undegraded":"2024-04-25T15:20:43.400983+0000","last_fullsized":"2024-04-25T15:20:43.400983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615637+0000","last_change":"2024-04-25T15:20:42.424790+0000","last_active":"2024-04-25T15:20:43.615637+0000","last_peered":"2024-04-25T15:20:43.615637+0000","last_clean":"2024-04-25T15:20:43.615637+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:20:43.615637+0000","last_undegraded":"2024-04-25T15:20:43.615637+0000","last_fullsized":"2024-04-25T15:20:43.615637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616578+0000","last_change":"2024-04-25T15:20:42.426982+0000","last_active":"2024-04-25T15:20:43.616578+0000","last_peered":"2024-04-25T15:20:43.616578+0000","last_clean":"2024-04-25T15:20:43.616578+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:20:43.616578+0000","last_undegraded":"2024-04-25T15:20:43.616578+0000","last_fullsized":"2024-04-25T15:20:43.616578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:08.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616451+0000","last_change":"2024-04-25T15:20:42.416175+0000","last_active":"2024-04-25T15:20:43.616451+0000","last_peered":"2024-04-25T15:20:43.616451+0000","last_clean":"2024-04-25T15:20:43.616451+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:20:43.616451+0000","last_undegraded":"2024-04-25T15:20:43.616451+0000","last_fullsized":"2024-04-25T15:20:43.616451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:12.712238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406285+0000","last_change":"2024-04-25T15:20:42.419392+0000","last_active":"2024-04-25T15:20:43.406285+0000","last_peered":"2024-04-25T15:20:43.406285+0000","last_clean":"2024-04-25T15:20:43.406285+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:20:43.406285+0000","last_undegraded":"2024-04-25T15:20:43.406285+0000","last_fullsized":"2024-04-25T15:20:43.406285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:14.498820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616583+0000","last_change":"2024-04-25T15:20:42.421681+0000","last_active":"2024-04-25T15:20:43.616583+0000","last_peered":"2024-04-25T15:20:43.616583+0000","last_clean":"2024-04-25T15:20:43.616583+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:20:43.616583+0000","last_undegraded":"2024-04-25T15:20:43.616583+0000","last_fullsized":"2024-04-25T15:20:43.616583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616401+0000","last_change":"2024-04-25T15:20:42.418252+0000","last_active":"2024-04-25T15:20:43.616401+0000","last_peered":"2024-04-25T15:20:43.616401+0000","last_clean":"2024-04-25T15:20:43.616401+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:20:43.616401+0000","last_undegraded":"2024-04-25T15:20:43.616401+0000","last_fullsized":"2024-04-25T15:20:43.616401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616126+0000","last_change":"2024-04-25T15:20:42.428193+0000","last_active":"2024-04-25T15:20:43.616126+0000","last_peered":"2024-04-25T15:20:43.616126+0000","last_clean":"2024-04-25T15:20:43.616126+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:20:43.616126+0000","last_undegraded":"2024-04-25T15:20:43.616126+0000","last_fullsized":"2024-04-25T15:20:43.616126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:34.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616784+0000","last_change":"2024-04-25T15:20:42.422940+0000","last_active":"2024-04-25T15:20:43.616784+0000","last_peered":"2024-04-25T15:20:43.616784+0000","last_clean":"2024-04-25T15:20:43.616784+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:20:43.616784+0000","last_undegraded":"2024-04-25T15:20:43.616784+0000","last_fullsized":"2024-04-25T15:20:43.616784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615727+0000","last_change":"2024-04-25T15:20:42.424516+0000","last_active":"2024-04-25T15:20:43.615727+0000","last_peered":"2024-04-25T15:20:43.615727+0000","last_clean":"2024-04-25T15:20:43.615727+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:20:43.615727+0000","last_undegraded":"2024-04-25T15:20:43.615727+0000","last_fullsized":"2024-04-25T15:20:43.615727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616785+0000","last_change":"2024-04-25T15:20:42.427631+0000","last_active":"2024-04-25T15:20:43.616785+0000","last_peered":"2024-04-25T15:20:43.616785+0000","last_clean":"2024-04-25T15:20:43.616785+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:20:43.616785+0000","last_undegraded":"2024-04-25T15:20:43.616785+0000","last_fullsized":"2024-04-25T15:20:43.616785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.617047+0000","last_change":"2024-04-25T15:20:42.425058+0000","last_active":"2024-04-25T15:20:43.617047+0000","last_peered":"2024-04-25T15:20:43.617047+0000","last_clean":"2024-04-25T15:20:43.617047+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:20:43.617047+0000","last_undegraded":"2024-04-25T15:20:43.617047+0000","last_fullsized":"2024-04-25T15:20:43.617047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401101+0000","last_change":"2024-04-25T15:20:42.428962+0000","last_active":"2024-04-25T15:20:43.401101+0000","last_peered":"2024-04-25T15:20:43.401101+0000","last_clean":"2024-04-25T15:20:43.401101+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:20:43.401101+0000","last_undegraded":"2024-04-25T15:20:43.401101+0000","last_fullsized":"2024-04-25T15:20:43.401101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616796+0000","last_change":"2024-04-25T15:20:42.428532+0000","last_active":"2024-04-25T15:20:43.616796+0000","last_peered":"2024-04-25T15:20:43.616796+0000","last_clean":"2024-04-25T15:20:43.616796+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:20:43.616796+0000","last_undegraded":"2024-04-25T15:20:43.616796+0000","last_fullsized":"2024-04-25T15:20:43.616796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616591+0000","last_change":"2024-04-25T15:20:42.422835+0000","last_active":"2024-04-25T15:20:43.616591+0000","last_peered":"2024-04-25T15:20:43.616591+0000","last_clean":"2024-04-25T15:20:43.616591+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:20:43.616591+0000","last_undegraded":"2024-04-25T15:20:43.616591+0000","last_fullsized":"2024-04-25T15:20:43.616591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616308+0000","last_change":"2024-04-25T15:20:42.424071+0000","last_active":"2024-04-25T15:20:43.616308+0000","last_peered":"2024-04-25T15:20:43.616308+0000","last_clean":"2024-04-25T15:20:43.616308+0000","last_became_active":"2024-04-25T15:20:42.423222+0000","last_became_peered":"2024-04-25T15:20:42.423222+0000","last_unstale":"2024-04-25T15:20:43.616308+0000","last_undegraded":"2024-04-25T15:20:43.616308+0000","last_fullsized":"2024-04-25T15:20:43.616308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:35.713134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615633+0000","last_change":"2024-04-25T15:20:42.430516+0000","last_active":"2024-04-25T15:20:43.615633+0000","last_peered":"2024-04-25T15:20:43.615633+0000","last_clean":"2024-04-25T15:20:43.615633+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:20:43.615633+0000","last_undegraded":"2024-04-25T15:20:43.615633+0000","last_fullsized":"2024-04-25T15:20:43.615633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:03.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615705+0000","last_change":"2024-04-25T15:20:42.418805+0000","last_active":"2024-04-25T15:20:43.615705+0000","last_peered":"2024-04-25T15:20:43.615705+0000","last_clean":"2024-04-25T15:20:43.615705+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:20:43.615705+0000","last_undegraded":"2024-04-25T15:20:43.615705+0000","last_fullsized":"2024-04-25T15:20:43.615705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406202+0000","last_change":"2024-04-25T15:20:42.418203+0000","last_active":"2024-04-25T15:20:43.406202+0000","last_peered":"2024-04-25T15:20:43.406202+0000","last_clean":"2024-04-25T15:20:43.406202+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:20:43.406202+0000","last_undegraded":"2024-04-25T15:20:43.406202+0000","last_fullsized":"2024-04-25T15:20:43.406202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:12.712238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616620+0000","last_change":"2024-04-25T15:20:41.411834+0000","last_active":"2024-04-25T15:20:43.616620+0000","last_peered":"2024-04-25T15:20:43.616620+0000","last_clean":"2024-04-25T15:20:43.616620+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:20:43.616620+0000","last_undegraded":"2024-04-25T15:20:43.616620+0000","last_fullsized":"2024-04-25T15:20:43.616620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616907+0000","last_change":"2024-04-25T15:20:42.412522+0000","last_active":"2024-04-25T15:20:43.616907+0000","last_peered":"2024-04-25T15:20:43.616907+0000","last_clean":"2024-04-25T15:20:43.616907+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:20:43.616907+0000","last_undegraded":"2024-04-25T15:20:43.616907+0000","last_fullsized":"2024-04-25T15:20:43.616907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616024+0000","last_change":"2024-04-25T15:20:41.401581+0000","last_active":"2024-04-25T15:20:43.616024+0000","last_peered":"2024-04-25T15:20:43.616024+0000","last_clean":"2024-04-25T15:20:43.616024+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:20:43.616024+0000","last_undegraded":"2024-04-25T15:20:43.616024+0000","last_fullsized":"2024-04-25T15:20:43.616024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615982+0000","last_change":"2024-04-25T15:20:41.404692+0000","last_active":"2024-04-25T15:20:43.615982+0000","last_peered":"2024-04-25T15:20:43.615982+0000","last_clean":"2024-04-25T15:20:43.615982+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:20:43.615982+0000","last_undegraded":"2024-04-25T15:20:43.615982+0000","last_fullsized":"2024-04-25T15:20:43.615982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615787+0000","last_change":"2024-04-25T15:20:42.413772+0000","last_active":"2024-04-25T15:20:43.615787+0000","last_peered":"2024-04-25T15:20:43.615787+0000","last_clean":"2024-04-25T15:20:43.615787+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:20:43.615787+0000","last_undegraded":"2024-04-25T15:20:43.615787+0000","last_fullsized":"2024-04-25T15:20:43.615787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615953+0000","last_change":"2024-04-25T15:20:41.406208+0000","last_active":"2024-04-25T15:20:43.615953+0000","last_peered":"2024-04-25T15:20:43.615953+0000","last_clean":"2024-04-25T15:20:43.615953+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:20:43.615953+0000","last_undegraded":"2024-04-25T15:20:43.615953+0000","last_fullsized":"2024-04-25T15:20:43.615953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400977+0000","last_change":"2024-04-25T15:20:42.427938+0000","last_active":"2024-04-25T15:20:43.400977+0000","last_peered":"2024-04-25T15:20:43.400977+0000","last_clean":"2024-04-25T15:20:43.400977+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:20:43.400977+0000","last_undegraded":"2024-04-25T15:20:43.400977+0000","last_fullsized":"2024-04-25T15:20:43.400977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616877+0000","last_change":"2024-04-25T15:20:41.406067+0000","last_active":"2024-04-25T15:20:43.616877+0000","last_peered":"2024-04-25T15:20:43.616877+0000","last_clean":"2024-04-25T15:20:43.616877+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:20:43.616877+0000","last_undegraded":"2024-04-25T15:20:43.616877+0000","last_fullsized":"2024-04-25T15:20:43.616877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616134+0000","last_change":"2024-04-25T15:20:42.426143+0000","last_active":"2024-04-25T15:20:43.616134+0000","last_peered":"2024-04-25T15:20:43.616134+0000","last_clean":"2024-04-25T15:20:43.616134+0000","last_became_active":"2024-04-25T15:20:42.425823+0000","last_became_peered":"2024-04-25T15:20:42.425823+0000","last_unstale":"2024-04-25T15:20:43.616134+0000","last_undegraded":"2024-04-25T15:20:43.616134+0000","last_fullsized":"2024-04-25T15:20:43.616134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616252+0000","last_change":"2024-04-25T15:20:41.410325+0000","last_active":"2024-04-25T15:20:43.616252+0000","last_peered":"2024-04-25T15:20:43.616252+0000","last_clean":"2024-04-25T15:20:43.616252+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:20:43.616252+0000","last_undegraded":"2024-04-25T15:20:43.616252+0000","last_fullsized":"2024-04-25T15:20:43.616252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.617013+0000","last_change":"2024-04-25T15:20:42.423079+0000","last_active":"2024-04-25T15:20:43.617013+0000","last_peered":"2024-04-25T15:20:43.617013+0000","last_clean":"2024-04-25T15:20:43.617013+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:20:43.617013+0000","last_undegraded":"2024-04-25T15:20:43.617013+0000","last_fullsized":"2024-04-25T15:20:43.617013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401225+0000","last_change":"2024-04-25T15:20:41.415893+0000","last_active":"2024-04-25T15:20:43.401225+0000","last_peered":"2024-04-25T15:20:43.401225+0000","last_clean":"2024-04-25T15:20:43.401225+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:20:43.401225+0000","last_undegraded":"2024-04-25T15:20:43.401225+0000","last_fullsized":"2024-04-25T15:20:43.401225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406160+0000","last_change":"2024-04-25T15:20:42.415485+0000","last_active":"2024-04-25T15:20:43.406160+0000","last_peered":"2024-04-25T15:20:43.406160+0000","last_clean":"2024-04-25T15:20:43.406160+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:20:43.406160+0000","last_undegraded":"2024-04-25T15:20:43.406160+0000","last_fullsized":"2024-04-25T15:20:43.406160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:03.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616702+0000","last_change":"2024-04-25T15:20:41.406750+0000","last_active":"2024-04-25T15:20:43.616702+0000","last_peered":"2024-04-25T15:20:43.616702+0000","last_clean":"2024-04-25T15:20:43.616702+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:20:43.616702+0000","last_undegraded":"2024-04-25T15:20:43.616702+0000","last_fullsized":"2024-04-25T15:20:43.616702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404818+0000","last_change":"2024-04-25T15:20:42.423197+0000","last_active":"2024-04-25T15:20:43.404818+0000","last_peered":"2024-04-25T15:20:43.404818+0000","last_clean":"2024-04-25T15:20:43.404818+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:20:43.404818+0000","last_undegraded":"2024-04-25T15:20:43.404818+0000","last_fullsized":"2024-04-25T15:20:43.404818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616717+0000","last_change":"2024-04-25T15:20:41.401705+0000","last_active":"2024-04-25T15:20:43.616717+0000","last_peered":"2024-04-25T15:20:43.616717+0000","last_clean":"2024-04-25T15:20:43.616717+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:20:43.616717+0000","last_undegraded":"2024-04-25T15:20:43.616717+0000","last_fullsized":"2024-04-25T15:20:43.616717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616538+0000","last_change":"2024-04-25T15:20:42.416896+0000","last_active":"2024-04-25T15:20:43.616538+0000","last_peered":"2024-04-25T15:20:43.616538+0000","last_clean":"2024-04-25T15:20:43.616538+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:20:43.616538+0000","last_undegraded":"2024-04-25T15:20:43.616538+0000","last_fullsized":"2024-04-25T15:20:43.616538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616404+0000","last_change":"2024-04-25T15:20:41.409212+0000","last_active":"2024-04-25T15:20:43.616404+0000","last_peered":"2024-04-25T15:20:43.616404+0000","last_clean":"2024-04-25T15:20:43.616404+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:20:43.616404+0000","last_undegraded":"2024-04-25T15:20:43.616404+0000","last_fullsized":"2024-04-25T15:20:43.616404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406079+0000","last_change":"2024-04-25T15:20:42.412386+0000","last_active":"2024-04-25T15:20:43.406079+0000","last_peered":"2024-04-25T15:20:43.406079+0000","last_clean":"2024-04-25T15:20:43.406079+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:20:43.406079+0000","last_undegraded":"2024-04-25T15:20:43.406079+0000","last_fullsized":"2024-04-25T15:20:43.406079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:16.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615809+0000","last_change":"2024-04-25T15:20:41.402015+0000","last_active":"2024-04-25T15:20:43.615809+0000","last_peered":"2024-04-25T15:20:43.615809+0000","last_clean":"2024-04-25T15:20:43.615809+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:20:43.615809+0000","last_undegraded":"2024-04-25T15:20:43.615809+0000","last_fullsized":"2024-04-25T15:20:43.615809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615723+0000","last_change":"2024-04-25T15:20:42.418565+0000","last_active":"2024-04-25T15:20:43.615723+0000","last_peered":"2024-04-25T15:20:43.615723+0000","last_clean":"2024-04-25T15:20:43.615723+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:20:43.615723+0000","last_undegraded":"2024-04-25T15:20:43.615723+0000","last_fullsized":"2024-04-25T15:20:43.615723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615665+0000","last_change":"2024-04-25T15:20:41.408427+0000","last_active":"2024-04-25T15:20:43.615665+0000","last_peered":"2024-04-25T15:20:43.615665+0000","last_clean":"2024-04-25T15:20:43.615665+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:20:43.615665+0000","last_undegraded":"2024-04-25T15:20:43.615665+0000","last_fullsized":"2024-04-25T15:20:43.615665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405200+0000","last_change":"2024-04-25T15:20:42.415542+0000","last_active":"2024-04-25T15:20:43.405200+0000","last_peered":"2024-04-25T15:20:43.405200+0000","last_clean":"2024-04-25T15:20:43.405200+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:20:43.405200+0000","last_undegraded":"2024-04-25T15:20:43.405200+0000","last_fullsized":"2024-04-25T15:20:43.405200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:08.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405718+0000","last_change":"2024-04-25T15:20:41.405515+0000","last_active":"2024-04-25T15:20:43.405718+0000","last_peered":"2024-04-25T15:20:43.405718+0000","last_clean":"2024-04-25T15:20:43.405718+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:20:43.405718+0000","last_undegraded":"2024-04-25T15:20:43.405718+0000","last_fullsized":"2024-04-25T15:20:43.405718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406362+0000","last_change":"2024-04-25T15:20:42.412473+0000","last_active":"2024-04-25T15:20:43.406362+0000","last_peered":"2024-04-25T15:20:43.406362+0000","last_clean":"2024-04-25T15:20:43.406362+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:20:43.406362+0000","last_undegraded":"2024-04-25T15:20:43.406362+0000","last_fullsized":"2024-04-25T15:20:43.406362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:37.101862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616569+0000","last_change":"2024-04-25T15:20:41.406806+0000","last_active":"2024-04-25T15:20:43.616569+0000","last_peered":"2024-04-25T15:20:43.616569+0000","last_clean":"2024-04-25T15:20:43.616569+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:20:43.616569+0000","last_undegraded":"2024-04-25T15:20:43.616569+0000","last_fullsized":"2024-04-25T15:20:43.616569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405950+0000","last_change":"2024-04-25T15:20:42.414216+0000","last_active":"2024-04-25T15:20:43.405950+0000","last_peered":"2024-04-25T15:20:43.405950+0000","last_clean":"2024-04-25T15:20:43.405950+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:20:43.405950+0000","last_undegraded":"2024-04-25T15:20:43.405950+0000","last_fullsized":"2024-04-25T15:20:43.405950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:11.295712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401342+0000","last_change":"2024-04-25T15:20:41.410562+0000","last_active":"2024-04-25T15:20:43.401342+0000","last_peered":"2024-04-25T15:20:43.401342+0000","last_clean":"2024-04-25T15:20:43.401342+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:20:43.401342+0000","last_undegraded":"2024-04-25T15:20:43.401342+0000","last_fullsized":"2024-04-25T15:20:43.401342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616931+0000","last_change":"2024-04-25T15:20:42.424064+0000","last_active":"2024-04-25T15:20:43.616931+0000","last_peered":"2024-04-25T15:20:43.616931+0000","last_clean":"2024-04-25T15:20:43.616931+0000","last_became_active":"2024-04-25T15:20:42.422759+0000","last_became_peered":"2024-04-25T15:20:42.422759+0000","last_unstale":"2024-04-25T15:20:43.616931+0000","last_undegraded":"2024-04-25T15:20:43.616931+0000","last_fullsized":"2024-04-25T15:20:43.616931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:16.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615991+0000","last_change":"2024-04-25T15:20:41.404065+0000","last_active":"2024-04-25T15:20:43.615991+0000","last_peered":"2024-04-25T15:20:43.615991+0000","last_clean":"2024-04-25T15:20:43.615991+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:20:43.615991+0000","last_undegraded":"2024-04-25T15:20:43.615991+0000","last_fullsized":"2024-04-25T15:20:43.615991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405069+0000","last_change":"2024-04-25T15:20:42.422505+0000","last_active":"2024-04-25T15:20:43.405069+0000","last_peered":"2024-04-25T15:20:43.405069+0000","last_clean":"2024-04-25T15:20:43.405069+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:20:43.405069+0000","last_undegraded":"2024-04-25T15:20:43.405069+0000","last_fullsized":"2024-04-25T15:20:43.405069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:35.713134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404763+0000","last_change":"2024-04-25T15:20:30.873208+0000","last_active":"2024-04-25T15:20:43.404763+0000","last_peered":"2024-04-25T15:20:43.404763+0000","last_clean":"2024-04-25T15:20:43.404763+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:20:43.404763+0000","last_undegraded":"2024-04-25T15:20:43.404763+0000","last_fullsized":"2024-04-25T15:20:43.404763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_clean_scrub_stamp":"2024-04-25T15:20:29.835147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:59.356200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615795+0000","last_change":"2024-04-25T15:20:41.403922+0000","last_active":"2024-04-25T15:20:43.615795+0000","last_peered":"2024-04-25T15:20:43.615795+0000","last_clean":"2024-04-25T15:20:43.615795+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:20:43.615795+0000","last_undegraded":"2024-04-25T15:20:43.615795+0000","last_fullsized":"2024-04-25T15:20:43.615795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616811+0000","last_change":"2024-04-25T15:20:42.432737+0000","last_active":"2024-04-25T15:20:43.616811+0000","last_peered":"2024-04-25T15:20:43.616811+0000","last_clean":"2024-04-25T15:20:43.616811+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:20:43.616811+0000","last_undegraded":"2024-04-25T15:20:43.616811+0000","last_fullsized":"2024-04-25T15:20:43.616811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:34.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405238+0000","last_change":"2024-04-25T15:20:41.410568+0000","last_active":"2024-04-25T15:20:43.405238+0000","last_peered":"2024-04-25T15:20:43.405238+0000","last_clean":"2024-04-25T15:20:43.405238+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:20:43.405238+0000","last_undegraded":"2024-04-25T15:20:43.405238+0000","last_fullsized":"2024-04-25T15:20:43.405238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616090+0000","last_change":"2024-04-25T15:20:42.410449+0000","last_active":"2024-04-25T15:20:43.616090+0000","last_peered":"2024-04-25T15:20:43.616090+0000","last_clean":"2024-04-25T15:20:43.616090+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:20:43.616090+0000","last_undegraded":"2024-04-25T15:20:43.616090+0000","last_fullsized":"2024-04-25T15:20:43.616090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:01.422318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615696+0000","last_change":"2024-04-25T15:20:41.406046+0000","last_active":"2024-04-25T15:20:43.615696+0000","last_peered":"2024-04-25T15:20:43.615696+0000","last_clean":"2024-04-25T15:20:43.615696+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:20:43.615696+0000","last_undegraded":"2024-04-25T15:20:43.615696+0000","last_fullsized":"2024-04-25T15:20:43.615696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400998+0000","last_change":"2024-04-25T15:20:42.419446+0000","last_active":"2024-04-25T15:20:43.400998+0000","last_peered":"2024-04-25T15:20:43.400998+0000","last_clean":"2024-04-25T15:20:43.400998+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:20:43.400998+0000","last_undegraded":"2024-04-25T15:20:43.400998+0000","last_fullsized":"2024-04-25T15:20:43.400998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616445+0000","last_change":"2024-04-25T15:20:41.410676+0000","last_active":"2024-04-25T15:20:43.616445+0000","last_peered":"2024-04-25T15:20:43.616445+0000","last_clean":"2024-04-25T15:20:43.616445+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:20:43.616445+0000","last_undegraded":"2024-04-25T15:20:43.616445+0000","last_fullsized":"2024-04-25T15:20:43.616445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405821+0000","last_change":"2024-04-25T15:20:42.406333+0000","last_active":"2024-04-25T15:20:43.405821+0000","last_peered":"2024-04-25T15:20:43.405821+0000","last_clean":"2024-04-25T15:20:43.405821+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:20:43.405821+0000","last_undegraded":"2024-04-25T15:20:43.405821+0000","last_fullsized":"2024-04-25T15:20:43.405821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:33.466178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401234+0000","last_change":"2024-04-25T15:20:41.413703+0000","last_active":"2024-04-25T15:20:43.401234+0000","last_peered":"2024-04-25T15:20:43.401234+0000","last_clean":"2024-04-25T15:20:43.401234+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:20:43.401234+0000","last_undegraded":"2024-04-25T15:20:43.401234+0000","last_fullsized":"2024-04-25T15:20:43.401234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616898+0000","last_change":"2024-04-25T15:20:42.424028+0000","last_active":"2024-04-25T15:20:43.616898+0000","last_peered":"2024-04-25T15:20:43.616898+0000","last_clean":"2024-04-25T15:20:43.616898+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:20:43.616898+0000","last_undegraded":"2024-04-25T15:20:43.616898+0000","last_fullsized":"2024-04-25T15:20:43.616898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:26.290972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406206+0000","last_change":"2024-04-25T15:20:41.408759+0000","last_active":"2024-04-25T15:20:43.406206+0000","last_peered":"2024-04-25T15:20:43.406206+0000","last_clean":"2024-04-25T15:20:43.406206+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:20:43.406206+0000","last_undegraded":"2024-04-25T15:20:43.406206+0000","last_fullsized":"2024-04-25T15:20:43.406206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:41.992733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401262+0000","last_change":"2024-04-25T15:20:42.418890+0000","last_active":"2024-04-25T15:20:43.401262+0000","last_peered":"2024-04-25T15:20:43.401262+0000","last_clean":"2024-04-25T15:20:43.401262+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:20:43.401262+0000","last_undegraded":"2024-04-25T15:20:43.401262+0000","last_fullsized":"2024-04-25T15:20:43.401262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:44.420974+0000","last_change":"2024-04-25T15:20:41.409877+0000","last_active":"2024-04-25T15:20:44.420974+0000","last_peered":"2024-04-25T15:20:44.420974+0000","last_clean":"2024-04-25T15:20:44.420974+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:20:44.420974+0000","last_undegraded":"2024-04-25T15:20:44.420974+0000","last_fullsized":"2024-04-25T15:20:44.420974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616942+0000","last_change":"2024-04-25T15:20:42.428777+0000","last_active":"2024-04-25T15:20:43.616942+0000","last_peered":"2024-04-25T15:20:43.616942+0000","last_clean":"2024-04-25T15:20:43.616942+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:20:43.616942+0000","last_undegraded":"2024-04-25T15:20:43.616942+0000","last_fullsized":"2024-04-25T15:20:43.616942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616981+0000","last_change":"2024-04-25T15:20:41.410949+0000","last_active":"2024-04-25T15:20:43.616981+0000","last_peered":"2024-04-25T15:20:43.616981+0000","last_clean":"2024-04-25T15:20:43.616981+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:20:43.616981+0000","last_undegraded":"2024-04-25T15:20:43.616981+0000","last_fullsized":"2024-04-25T15:20:43.616981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616443+0000","last_change":"2024-04-25T15:20:42.413542+0000","last_active":"2024-04-25T15:20:43.616443+0000","last_peered":"2024-04-25T15:20:43.616443+0000","last_clean":"2024-04-25T15:20:43.616443+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:20:43.616443+0000","last_undegraded":"2024-04-25T15:20:43.616443+0000","last_fullsized":"2024-04-25T15:20:43.616443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404657+0000","last_change":"2024-04-25T15:20:41.405078+0000","last_active":"2024-04-25T15:20:43.404657+0000","last_peered":"2024-04-25T15:20:43.404657+0000","last_clean":"2024-04-25T15:20:43.404657+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:20:43.404657+0000","last_undegraded":"2024-04-25T15:20:43.404657+0000","last_fullsized":"2024-04-25T15:20:43.404657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406027+0000","last_change":"2024-04-25T15:20:42.413408+0000","last_active":"2024-04-25T15:20:43.406027+0000","last_peered":"2024-04-25T15:20:43.406027+0000","last_clean":"2024-04-25T15:20:43.406027+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:20:43.406027+0000","last_undegraded":"2024-04-25T15:20:43.406027+0000","last_fullsized":"2024-04-25T15:20:43.406027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:37.360885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401097+0000","last_change":"2024-04-25T15:20:41.411766+0000","last_active":"2024-04-25T15:20:43.401097+0000","last_peered":"2024-04-25T15:20:43.401097+0000","last_clean":"2024-04-25T15:20:43.401097+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:20:43.401097+0000","last_undegraded":"2024-04-25T15:20:43.401097+0000","last_fullsized":"2024-04-25T15:20:43.401097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616281+0000","last_change":"2024-04-25T15:20:42.417444+0000","last_active":"2024-04-25T15:20:43.616281+0000","last_peered":"2024-04-25T15:20:43.616281+0000","last_clean":"2024-04-25T15:20:43.616281+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:20:43.616281+0000","last_undegraded":"2024-04-25T15:20:43.616281+0000","last_fullsized":"2024-04-25T15:20:43.616281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401096+0000","last_change":"2024-04-25T15:20:41.406926+0000","last_active":"2024-04-25T15:20:43.401096+0000","last_peered":"2024-04-25T15:20:43.401096+0000","last_clean":"2024-04-25T15:20:43.401096+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:20:43.401096+0000","last_undegraded":"2024-04-25T15:20:43.401096+0000","last_fullsized":"2024-04-25T15:20:43.401096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616486+0000","last_change":"2024-04-25T15:20:42.422510+0000","last_active":"2024-04-25T15:20:43.616486+0000","last_peered":"2024-04-25T15:20:43.616486+0000","last_clean":"2024-04-25T15:20:43.616486+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:20:43.616486+0000","last_undegraded":"2024-04-25T15:20:43.616486+0000","last_fullsized":"2024-04-25T15:20:43.616486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406194+0000","last_change":"2024-04-25T15:20:41.408140+0000","last_active":"2024-04-25T15:20:43.406194+0000","last_peered":"2024-04-25T15:20:43.406194+0000","last_clean":"2024-04-25T15:20:43.406194+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:20:43.406194+0000","last_undegraded":"2024-04-25T15:20:43.406194+0000","last_fullsized":"2024-04-25T15:20:43.406194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615884+0000","last_change":"2024-04-25T15:20:42.421911+0000","last_active":"2024-04-25T15:20:43.615884+0000","last_peered":"2024-04-25T15:20:43.615884+0000","last_clean":"2024-04-25T15:20:43.615884+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:20:43.615884+0000","last_undegraded":"2024-04-25T15:20:43.615884+0000","last_fullsized":"2024-04-25T15:20:43.615884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616795+0000","last_change":"2024-04-25T15:20:42.421340+0000","last_active":"2024-04-25T15:20:43.616795+0000","last_peered":"2024-04-25T15:20:43.616795+0000","last_clean":"2024-04-25T15:20:43.616795+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:20:43.616795+0000","last_undegraded":"2024-04-25T15:20:43.616795+0000","last_fullsized":"2024-04-25T15:20:43.616795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:11.295712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405091+0000","last_change":"2024-04-25T15:20:41.408459+0000","last_active":"2024-04-25T15:20:43.405091+0000","last_peered":"2024-04-25T15:20:43.405091+0000","last_clean":"2024-04-25T15:20:43.405091+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:20:43.405091+0000","last_undegraded":"2024-04-25T15:20:43.405091+0000","last_fullsized":"2024-04-25T15:20:43.405091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616609+0000","last_change":"2024-04-25T15:20:42.421601+0000","last_active":"2024-04-25T15:20:43.616609+0000","last_peered":"2024-04-25T15:20:43.616609+0000","last_clean":"2024-04-25T15:20:43.616609+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:20:43.616609+0000","last_undegraded":"2024-04-25T15:20:43.616609+0000","last_fullsized":"2024-04-25T15:20:43.616609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:41.305637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405989+0000","last_change":"2024-04-25T15:20:41.408914+0000","last_active":"2024-04-25T15:20:43.405989+0000","last_peered":"2024-04-25T15:20:43.405989+0000","last_clean":"2024-04-25T15:20:43.405989+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:20:43.405989+0000","last_undegraded":"2024-04-25T15:20:43.405989+0000","last_fullsized":"2024-04-25T15:20:43.405989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.598854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616433+0000","last_change":"2024-04-25T15:20:42.423383+0000","last_active":"2024-04-25T15:20:43.616433+0000","last_peered":"2024-04-25T15:20:43.616433+0000","last_clean":"2024-04-25T15:20:43.616433+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:20:43.616433+0000","last_undegraded":"2024-04-25T15:20:43.616433+0000","last_fullsized":"2024-04-25T15:20:43.616433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616854+0000","last_change":"2024-04-25T15:20:41.405976+0000","last_active":"2024-04-25T15:20:43.616854+0000","last_peered":"2024-04-25T15:20:43.616854+0000","last_clean":"2024-04-25T15:20:43.616854+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:20:43.616854+0000","last_undegraded":"2024-04-25T15:20:43.616854+0000","last_fullsized":"2024-04-25T15:20:43.616854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616697+0000","last_change":"2024-04-25T15:20:42.429601+0000","last_active":"2024-04-25T15:20:43.616697+0000","last_peered":"2024-04-25T15:20:43.616697+0000","last_clean":"2024-04-25T15:20:43.616697+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:20:43.616697+0000","last_undegraded":"2024-04-25T15:20:43.616697+0000","last_fullsized":"2024-04-25T15:20:43.616697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616853+0000","last_change":"2024-04-25T15:20:41.410750+0000","last_active":"2024-04-25T15:20:43.616853+0000","last_peered":"2024-04-25T15:20:43.616853+0000","last_clean":"2024-04-25T15:20:43.616853+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:20:43.616853+0000","last_undegraded":"2024-04-25T15:20:43.616853+0000","last_fullsized":"2024-04-25T15:20:43.616853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:20:51.150 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:20:51.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.296+0000 7fedb239d640 1 Processor -- start 2024-04-25T15:20:51.298 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.297+0000 7fedb239d640 1 -- start start 2024-04-25T15:20:51.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb239d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fedac143860 0x7fedac0ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb239d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fedac06ce80 0x7fedac14cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb239d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedac0be030 con 0x7fedac06d290 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb239d640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fedac0be680 con 0x7fedac06ce80 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb239d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fedac0be310 con 0x7fedac143860 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb0b9a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fedac06ce80 0x7fedac14cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb0b9a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fedac06ce80 0x7fedac14cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51462/0 (socket says 172.21.15.33:51462) 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb0b9a640 1 -- 172.21.15.33:0/999627009 learned_addr learned my addr 172.21.15.33:0/999627009 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb139b640 1 --2- 172.21.15.33:0/999627009 >> v2:172.21.15.155:3300/0 conn(0x7fedac143860 0x7fedac0ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb0b9a640 1 -- 172.21.15.33:0/999627009 >> v2:172.21.15.155:3300/0 conn(0x7fedac143860 msgr2=0x7fedac0ba070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb0b9a640 1 --2- 172.21.15.33:0/999627009 >> v2:172.21.15.155:3300/0 conn(0x7fedac143860 0x7fedac0ba070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb0b9a640 1 -- 172.21.15.33:0/999627009 >> v1:172.21.15.155:6789/0 conn(0x7fedac06d290 legacy=0x7fedac149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.298+0000 7fedb0b9a640 1 -- 172.21.15.33:0/999627009 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac0ba5b0 con 0x7fedac06ce80 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.299+0000 7fedb0b9a640 1 --2- 172.21.15.33:0/999627009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06ce80 0x7fedac14cdc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fedac06eff0 tx=0x7fed9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e18e97032a9d59c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.299+0000 7feda3fff640 1 -- 172.21.15.33:0/999627009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c037070 con 0x7fedac06ce80 2024-04-25T15:20:51.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.299+0000 7feda3fff640 1 -- 172.21.15.33:0/999627009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9c032440 con 0x7fedac06ce80 2024-04-25T15:20:51.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.299+0000 7feda3fff640 1 -- 172.21.15.33:0/999627009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c032810 con 0x7fedac06ce80 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.300+0000 7fedb239d640 1 -- 172.21.15.33:0/999627009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06ce80 msgr2=0x7fedac14cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.300+0000 7fedb239d640 1 --2- 172.21.15.33:0/999627009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06ce80 0x7fedac14cdc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fedac06eff0 tx=0x7fed9c02a1e0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.300+0000 7fedb239d640 1 -- 172.21.15.33:0/999627009 shutdown_connections 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.300+0000 7fedb239d640 1 --2- 172.21.15.33:0/999627009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06ce80 0x7fedac14cdc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.300+0000 7fedb239d640 1 --2- 172.21.15.33:0/999627009 >> v2:172.21.15.155:3300/0 conn(0x7fedac143860 0x7fedac0ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.300+0000 7fedb239d640 1 -- 172.21.15.33:0/999627009 >> 172.21.15.33:0/999627009 conn(0x7fedac0bea50 msgr2=0x7fedac0bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.300+0000 7fedb239d640 1 -- 172.21.15.33:0/999627009 shutdown_connections 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.300+0000 7fedb239d640 1 -- 172.21.15.33:0/999627009 wait complete. 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.301+0000 7fedb239d640 1 Processor -- start 2024-04-25T15:20:51.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.301+0000 7fedb239d640 1 -- start start 2024-04-25T15:20:51.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.302+0000 7fedb239d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedac06ce80 0x7fedac1e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.302+0000 7fedb239d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06d290 0x7fedac1d6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.302+0000 7fedb239d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac143860 0x7fedac142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.302+0000 7fedb239d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fedac0bdd20 con 0x7fedac06d290 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.302+0000 7fedb239d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fedac0bdba0 con 0x7fedac06ce80 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.302+0000 7fedb239d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fedac14d300 con 0x7fedac143860 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06d290 0x7fedac1d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06d290 0x7fedac1d6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51470/0 (socket says 172.21.15.33:51470) 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 -- 172.21.15.33:0/2580108589 learned_addr learned my addr 172.21.15.33:0/2580108589 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb139b640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedac06ce80 0x7fedac1e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb1b9c640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac143860 0x7fedac142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 -- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac143860 msgr2=0x7fedac142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac143860 0x7fedac142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 -- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedac06ce80 msgr2=0x7fedac1e2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedac06ce80 0x7fedac1e2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 -- 172.21.15.33:0/2580108589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac146bf0 con 0x7fedac06d290 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb0b9a640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06d290 0x7fedac1d6050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed9c000c00 tx=0x7fed9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7feda1ffb640 1 -- 172.21.15.33:0/2580108589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c041020 con 0x7fedac06d290 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7feda1ffb640 1 -- 172.21.15.33:0/2580108589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9c0306c0 con 0x7fedac06d290 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedac0b6ad0 con 0x7fedac06d290 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.303+0000 7feda1ffb640 1 -- 172.21.15.33:0/2580108589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c037040 con 0x7fedac06d290 2024-04-25T15:20:51.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.304+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedac14d6c0 con 0x7fedac06d290 2024-04-25T15:20:51.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.305+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedac076c00 con 0x7fedac06d290 2024-04-25T15:20:51.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.305+0000 7feda1ffb640 1 -- 172.21.15.33:0/2580108589 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed9c044020 con 0x7fedac06d290 2024-04-25T15:20:51.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.306+0000 7feda1ffb640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fed900744b0 0x7fed900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.306+0000 7feda1ffb640 1 -- 172.21.15.33:0/2580108589 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fed9c0b58e0 con 0x7fedac06d290 2024-04-25T15:20:51.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.306+0000 7fedb139b640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fed900744b0 0x7fed900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.307+0000 7fedb139b640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fed900744b0 0x7fed900769c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feda80079a0 tx=0x7feda8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:51.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.310+0000 7feda1ffb640 1 -- 172.21.15.33:0/2580108589 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed9c04b030 con 0x7fedac06d290 2024-04-25T15:20:51.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.493+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedac145ba0 con 0x7fed900744b0 2024-04-25T15:20:51.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.499+0000 7feda1ffb640 1 -- 172.21.15.33:0/2580108589 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7fedac145ba0 con 0x7fed900744b0 2024-04-25T15:20:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:51.505 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:20:51.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.502+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fed900744b0 msgr2=0x7fed900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.502+0000 7fedb239d640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fed900744b0 0x7fed900769c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feda80079a0 tx=0x7feda8008040 comp rx=0 tx=0).stop 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.502+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06d290 msgr2=0x7fedac1d6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.502+0000 7fedb239d640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06d290 0x7fedac1d6050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed9c000c00 tx=0x7fed9c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.503+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 shutdown_connections 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.503+0000 7fedb239d640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fed900744b0 0x7fed900769c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.503+0000 7fedb239d640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedac143860 0x7fedac142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.503+0000 7fedb239d640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedac06d290 0x7fedac1d6050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.503+0000 7fedb239d640 1 --2- 172.21.15.33:0/2580108589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedac06ce80 0x7fedac1e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.503+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 >> 172.21.15.33:0/2580108589 conn(0x7fedac0bea50 msgr2=0x7fedac0b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.503+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 shutdown_connections 2024-04-25T15:20:51.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.503+0000 7fedb239d640 1 -- 172.21.15.33:0/2580108589 wait complete. 2024-04-25T15:20:51.515 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T15:20:49.707031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219024,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755696,"statfs":{"total":773094113280,"available":772869832704,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002273"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405573+0000","last_change":"2024-04-25T15:20:42.418715+0000","last_active":"2024-04-25T15:20:43.405573+0000","last_peered":"2024-04-25T15:20:43.405573+0000","last_clean":"2024-04-25T15:20:43.405573+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:20:43.405573+0000","last_undegraded":"2024-04-25T15:20:43.405573+0000","last_fullsized":"2024-04-25T15:20:43.405573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.236522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401337+0000","last_change":"2024-04-25T15:20:42.417722+0000","last_active":"2024-04-25T15:20:43.401337+0000","last_peered":"2024-04-25T15:20:43.401337+0000","last_clean":"2024-04-25T15:20:43.401337+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:20:43.401337+0000","last_undegraded":"2024-04-25T15:20:43.401337+0000","last_fullsized":"2024-04-25T15:20:43.401337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616831+0000","last_change":"2024-04-25T15:20:42.414889+0000","last_active":"2024-04-25T15:20:43.616831+0000","last_peered":"2024-04-25T15:20:43.616831+0000","last_clean":"2024-04-25T15:20:43.616831+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:20:43.616831+0000","last_undegraded":"2024-04-25T15:20:43.616831+0000","last_fullsized":"2024-04-25T15:20:43.616831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616592+0000","last_change":"2024-04-25T15:20:42.423112+0000","last_active":"2024-04-25T15:20:43.616592+0000","last_peered":"2024-04-25T15:20:43.616592+0000","last_clean":"2024-04-25T15:20:43.616592+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:20:43.616592+0000","last_undegraded":"2024-04-25T15:20:43.616592+0000","last_fullsized":"2024-04-25T15:20:43.616592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:44.236522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406049+0000","last_change":"2024-04-25T15:20:42.417398+0000","last_active":"2024-04-25T15:20:43.406049+0000","last_peered":"2024-04-25T15:20:43.406049+0000","last_clean":"2024-04-25T15:20:43.406049+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:20:43.406049+0000","last_undegraded":"2024-04-25T15:20:43.406049+0000","last_fullsized":"2024-04-25T15:20:43.406049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:26.290972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616266+0000","last_change":"2024-04-25T15:20:42.424408+0000","last_active":"2024-04-25T15:20:43.616266+0000","last_peered":"2024-04-25T15:20:43.616266+0000","last_clean":"2024-04-25T15:20:43.616266+0000","last_became_active":"2024-04-25T15:20:42.423560+0000","last_became_peered":"2024-04-25T15:20:42.423560+0000","last_unstale":"2024-04-25T15:20:43.616266+0000","last_undegraded":"2024-04-25T15:20:43.616266+0000","last_fullsized":"2024-04-25T15:20:43.616266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404956+0000","last_change":"2024-04-25T15:20:42.413800+0000","last_active":"2024-04-25T15:20:43.404956+0000","last_peered":"2024-04-25T15:20:43.404956+0000","last_clean":"2024-04-25T15:20:43.404956+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:20:43.404956+0000","last_undegraded":"2024-04-25T15:20:43.404956+0000","last_fullsized":"2024-04-25T15:20:43.404956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615647+0000","last_change":"2024-04-25T15:20:42.431896+0000","last_active":"2024-04-25T15:20:43.615647+0000","last_peered":"2024-04-25T15:20:43.615647+0000","last_clean":"2024-04-25T15:20:43.615647+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:20:43.615647+0000","last_undegraded":"2024-04-25T15:20:43.615647+0000","last_fullsized":"2024-04-25T15:20:43.615647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405749+0000","last_change":"2024-04-25T15:20:42.420423+0000","last_active":"2024-04-25T15:20:43.405749+0000","last_peered":"2024-04-25T15:20:43.405749+0000","last_clean":"2024-04-25T15:20:43.405749+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:20:43.405749+0000","last_undegraded":"2024-04-25T15:20:43.405749+0000","last_fullsized":"2024-04-25T15:20:43.405749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:41.305637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616917+0000","last_change":"2024-04-25T15:20:42.428177+0000","last_active":"2024-04-25T15:20:43.616917+0000","last_peered":"2024-04-25T15:20:43.616917+0000","last_clean":"2024-04-25T15:20:43.616917+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:20:43.616917+0000","last_undegraded":"2024-04-25T15:20:43.616917+0000","last_fullsized":"2024-04-25T15:20:43.616917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616285+0000","last_change":"2024-04-25T15:20:42.420688+0000","last_active":"2024-04-25T15:20:43.616285+0000","last_peered":"2024-04-25T15:20:43.616285+0000","last_clean":"2024-04-25T15:20:43.616285+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:20:43.616285+0000","last_undegraded":"2024-04-25T15:20:43.616285+0000","last_fullsized":"2024-04-25T15:20:43.616285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405959+0000","last_change":"2024-04-25T15:20:42.412698+0000","last_active":"2024-04-25T15:20:43.405959+0000","last_peered":"2024-04-25T15:20:43.405959+0000","last_clean":"2024-04-25T15:20:43.405959+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:20:43.405959+0000","last_undegraded":"2024-04-25T15:20:43.405959+0000","last_fullsized":"2024-04-25T15:20:43.405959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:21.373351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616977+0000","last_change":"2024-04-25T15:20:42.427925+0000","last_active":"2024-04-25T15:20:43.616977+0000","last_peered":"2024-04-25T15:20:43.616977+0000","last_clean":"2024-04-25T15:20:43.616977+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:20:43.616977+0000","last_undegraded":"2024-04-25T15:20:43.616977+0000","last_fullsized":"2024-04-25T15:20:43.616977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:38:07.158458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616364+0000","last_change":"2024-04-25T15:20:42.417743+0000","last_active":"2024-04-25T15:20:43.616364+0000","last_peered":"2024-04-25T15:20:43.616364+0000","last_clean":"2024-04-25T15:20:43.616364+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:20:43.616364+0000","last_undegraded":"2024-04-25T15:20:43.616364+0000","last_fullsized":"2024-04-25T15:20:43.616364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:57:45.392358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400983+0000","last_change":"2024-04-25T15:20:42.415903+0000","last_active":"2024-04-25T15:20:43.400983+0000","last_peered":"2024-04-25T15:20:43.400983+0000","last_clean":"2024-04-25T15:20:43.400983+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:20:43.400983+0000","last_undegraded":"2024-04-25T15:20:43.400983+0000","last_fullsized":"2024-04-25T15:20:43.400983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615637+0000","last_change":"2024-04-25T15:20:42.424790+0000","last_active":"2024-04-25T15:20:43.615637+0000","last_peered":"2024-04-25T15:20:43.615637+0000","last_clean":"2024-04-25T15:20:43.615637+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:20:43.615637+0000","last_undegraded":"2024-04-25T15:20:43.615637+0000","last_fullsized":"2024-04-25T15:20:43.615637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616578+0000","last_change":"2024-04-25T15:20:42.426982+0000","last_active":"2024-04-25T15:20:43.616578+0000","last_peered":"2024-04-25T15:20:43.616578+0000","last_clean":"2024-04-25T15:20:43.616578+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:20:43.616578+0000","last_undegraded":"2024-04-25T15:20:43.616578+0000","last_fullsized":"2024-04-25T15:20:43.616578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:08.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616451+0000","last_change":"2024-04-25T15:20:42.416175+0000","last_active":"2024-04-25T15:20:43.616451+0000","last_peered":"2024-04-25T15:20:43.616451+0000","last_clean":"2024-04-25T15:20:43.616451+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:20:43.616451+0000","last_undegraded":"2024-04-25T15:20:43.616451+0000","last_fullsized":"2024-04-25T15:20:43.616451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:12.712238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406285+0000","last_change":"2024-04-25T15:20:42.419392+0000","last_active":"2024-04-25T15:20:43.406285+0000","last_peered":"2024-04-25T15:20:43.406285+0000","last_clean":"2024-04-25T15:20:43.406285+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:20:43.406285+0000","last_undegraded":"2024-04-25T15:20:43.406285+0000","last_fullsized":"2024-04-25T15:20:43.406285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:43:14.498820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616583+0000","last_change":"2024-04-25T15:20:42.421681+0000","last_active":"2024-04-25T15:20:43.616583+0000","last_peered":"2024-04-25T15:20:43.616583+0000","last_clean":"2024-04-25T15:20:43.616583+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:20:43.616583+0000","last_undegraded":"2024-04-25T15:20:43.616583+0000","last_fullsized":"2024-04-25T15:20:43.616583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616401+0000","last_change":"2024-04-25T15:20:42.418252+0000","last_active":"2024-04-25T15:20:43.616401+0000","last_peered":"2024-04-25T15:20:43.616401+0000","last_clean":"2024-04-25T15:20:43.616401+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:20:43.616401+0000","last_undegraded":"2024-04-25T15:20:43.616401+0000","last_fullsized":"2024-04-25T15:20:43.616401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616126+0000","last_change":"2024-04-25T15:20:42.428193+0000","last_active":"2024-04-25T15:20:43.616126+0000","last_peered":"2024-04-25T15:20:43.616126+0000","last_clean":"2024-04-25T15:20:43.616126+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:20:43.616126+0000","last_undegraded":"2024-04-25T15:20:43.616126+0000","last_fullsized":"2024-04-25T15:20:43.616126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:34.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616784+0000","last_change":"2024-04-25T15:20:42.422940+0000","last_active":"2024-04-25T15:20:43.616784+0000","last_peered":"2024-04-25T15:20:43.616784+0000","last_clean":"2024-04-25T15:20:43.616784+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:20:43.616784+0000","last_undegraded":"2024-04-25T15:20:43.616784+0000","last_fullsized":"2024-04-25T15:20:43.616784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615727+0000","last_change":"2024-04-25T15:20:42.424516+0000","last_active":"2024-04-25T15:20:43.615727+0000","last_peered":"2024-04-25T15:20:43.615727+0000","last_clean":"2024-04-25T15:20:43.615727+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:20:43.615727+0000","last_undegraded":"2024-04-25T15:20:43.615727+0000","last_fullsized":"2024-04-25T15:20:43.615727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616785+0000","last_change":"2024-04-25T15:20:42.427631+0000","last_active":"2024-04-25T15:20:43.616785+0000","last_peered":"2024-04-25T15:20:43.616785+0000","last_clean":"2024-04-25T15:20:43.616785+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:20:43.616785+0000","last_undegraded":"2024-04-25T15:20:43.616785+0000","last_fullsized":"2024-04-25T15:20:43.616785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.617047+0000","last_change":"2024-04-25T15:20:42.425058+0000","last_active":"2024-04-25T15:20:43.617047+0000","last_peered":"2024-04-25T15:20:43.617047+0000","last_clean":"2024-04-25T15:20:43.617047+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:20:43.617047+0000","last_undegraded":"2024-04-25T15:20:43.617047+0000","last_fullsized":"2024-04-25T15:20:43.617047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401101+0000","last_change":"2024-04-25T15:20:42.428962+0000","last_active":"2024-04-25T15:20:43.401101+0000","last_peered":"2024-04-25T15:20:43.401101+0000","last_clean":"2024-04-25T15:20:43.401101+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:20:43.401101+0000","last_undegraded":"2024-04-25T15:20:43.401101+0000","last_fullsized":"2024-04-25T15:20:43.401101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:02.179166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616796+0000","last_change":"2024-04-25T15:20:42.428532+0000","last_active":"2024-04-25T15:20:43.616796+0000","last_peered":"2024-04-25T15:20:43.616796+0000","last_clean":"2024-04-25T15:20:43.616796+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:20:43.616796+0000","last_undegraded":"2024-04-25T15:20:43.616796+0000","last_fullsized":"2024-04-25T15:20:43.616796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616591+0000","last_change":"2024-04-25T15:20:42.422835+0000","last_active":"2024-04-25T15:20:43.616591+0000","last_peered":"2024-04-25T15:20:43.616591+0000","last_clean":"2024-04-25T15:20:43.616591+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:20:43.616591+0000","last_undegraded":"2024-04-25T15:20:43.616591+0000","last_fullsized":"2024-04-25T15:20:43.616591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616308+0000","last_change":"2024-04-25T15:20:42.424071+0000","last_active":"2024-04-25T15:20:43.616308+0000","last_peered":"2024-04-25T15:20:43.616308+0000","last_clean":"2024-04-25T15:20:43.616308+0000","last_became_active":"2024-04-25T15:20:42.423222+0000","last_became_peered":"2024-04-25T15:20:42.423222+0000","last_unstale":"2024-04-25T15:20:43.616308+0000","last_undegraded":"2024-04-25T15:20:43.616308+0000","last_fullsized":"2024-04-25T15:20:43.616308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:35.713134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615633+0000","last_change":"2024-04-25T15:20:42.430516+0000","last_active":"2024-04-25T15:20:43.615633+0000","last_peered":"2024-04-25T15:20:43.615633+0000","last_clean":"2024-04-25T15:20:43.615633+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:20:43.615633+0000","last_undegraded":"2024-04-25T15:20:43.615633+0000","last_fullsized":"2024-04-25T15:20:43.615633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:03.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615705+0000","last_change":"2024-04-25T15:20:42.418805+0000","last_active":"2024-04-25T15:20:43.615705+0000","last_peered":"2024-04-25T15:20:43.615705+0000","last_clean":"2024-04-25T15:20:43.615705+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:20:43.615705+0000","last_undegraded":"2024-04-25T15:20:43.615705+0000","last_fullsized":"2024-04-25T15:20:43.615705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:06:25.553043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406202+0000","last_change":"2024-04-25T15:20:42.418203+0000","last_active":"2024-04-25T15:20:43.406202+0000","last_peered":"2024-04-25T15:20:43.406202+0000","last_clean":"2024-04-25T15:20:43.406202+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:20:43.406202+0000","last_undegraded":"2024-04-25T15:20:43.406202+0000","last_fullsized":"2024-04-25T15:20:43.406202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:12.712238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616620+0000","last_change":"2024-04-25T15:20:41.411834+0000","last_active":"2024-04-25T15:20:43.616620+0000","last_peered":"2024-04-25T15:20:43.616620+0000","last_clean":"2024-04-25T15:20:43.616620+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:20:43.616620+0000","last_undegraded":"2024-04-25T15:20:43.616620+0000","last_fullsized":"2024-04-25T15:20:43.616620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616907+0000","last_change":"2024-04-25T15:20:42.412522+0000","last_active":"2024-04-25T15:20:43.616907+0000","last_peered":"2024-04-25T15:20:43.616907+0000","last_clean":"2024-04-25T15:20:43.616907+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:20:43.616907+0000","last_undegraded":"2024-04-25T15:20:43.616907+0000","last_fullsized":"2024-04-25T15:20:43.616907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616024+0000","last_change":"2024-04-25T15:20:41.401581+0000","last_active":"2024-04-25T15:20:43.616024+0000","last_peered":"2024-04-25T15:20:43.616024+0000","last_clean":"2024-04-25T15:20:43.616024+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:20:43.616024+0000","last_undegraded":"2024-04-25T15:20:43.616024+0000","last_fullsized":"2024-04-25T15:20:43.616024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615982+0000","last_change":"2024-04-25T15:20:41.404692+0000","last_active":"2024-04-25T15:20:43.615982+0000","last_peered":"2024-04-25T15:20:43.615982+0000","last_clean":"2024-04-25T15:20:43.615982+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:20:43.615982+0000","last_undegraded":"2024-04-25T15:20:43.615982+0000","last_fullsized":"2024-04-25T15:20:43.615982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615787+0000","last_change":"2024-04-25T15:20:42.413772+0000","last_active":"2024-04-25T15:20:43.615787+0000","last_peered":"2024-04-25T15:20:43.615787+0000","last_clean":"2024-04-25T15:20:43.615787+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:20:43.615787+0000","last_undegraded":"2024-04-25T15:20:43.615787+0000","last_fullsized":"2024-04-25T15:20:43.615787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615953+0000","last_change":"2024-04-25T15:20:41.406208+0000","last_active":"2024-04-25T15:20:43.615953+0000","last_peered":"2024-04-25T15:20:43.615953+0000","last_clean":"2024-04-25T15:20:43.615953+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:20:43.615953+0000","last_undegraded":"2024-04-25T15:20:43.615953+0000","last_fullsized":"2024-04-25T15:20:43.615953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400977+0000","last_change":"2024-04-25T15:20:42.427938+0000","last_active":"2024-04-25T15:20:43.400977+0000","last_peered":"2024-04-25T15:20:43.400977+0000","last_clean":"2024-04-25T15:20:43.400977+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:20:43.400977+0000","last_undegraded":"2024-04-25T15:20:43.400977+0000","last_fullsized":"2024-04-25T15:20:43.400977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616877+0000","last_change":"2024-04-25T15:20:41.406067+0000","last_active":"2024-04-25T15:20:43.616877+0000","last_peered":"2024-04-25T15:20:43.616877+0000","last_clean":"2024-04-25T15:20:43.616877+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:20:43.616877+0000","last_undegraded":"2024-04-25T15:20:43.616877+0000","last_fullsized":"2024-04-25T15:20:43.616877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616134+0000","last_change":"2024-04-25T15:20:42.426143+0000","last_active":"2024-04-25T15:20:43.616134+0000","last_peered":"2024-04-25T15:20:43.616134+0000","last_clean":"2024-04-25T15:20:43.616134+0000","last_became_active":"2024-04-25T15:20:42.425823+0000","last_became_peered":"2024-04-25T15:20:42.425823+0000","last_unstale":"2024-04-25T15:20:43.616134+0000","last_undegraded":"2024-04-25T15:20:43.616134+0000","last_fullsized":"2024-04-25T15:20:43.616134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616252+0000","last_change":"2024-04-25T15:20:41.410325+0000","last_active":"2024-04-25T15:20:43.616252+0000","last_peered":"2024-04-25T15:20:43.616252+0000","last_clean":"2024-04-25T15:20:43.616252+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:20:43.616252+0000","last_undegraded":"2024-04-25T15:20:43.616252+0000","last_fullsized":"2024-04-25T15:20:43.616252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.617013+0000","last_change":"2024-04-25T15:20:42.423079+0000","last_active":"2024-04-25T15:20:43.617013+0000","last_peered":"2024-04-25T15:20:43.617013+0000","last_clean":"2024-04-25T15:20:43.617013+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:20:43.617013+0000","last_undegraded":"2024-04-25T15:20:43.617013+0000","last_fullsized":"2024-04-25T15:20:43.617013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:59.129617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401225+0000","last_change":"2024-04-25T15:20:41.415893+0000","last_active":"2024-04-25T15:20:43.401225+0000","last_peered":"2024-04-25T15:20:43.401225+0000","last_clean":"2024-04-25T15:20:43.401225+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:20:43.401225+0000","last_undegraded":"2024-04-25T15:20:43.401225+0000","last_fullsized":"2024-04-25T15:20:43.401225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406160+0000","last_change":"2024-04-25T15:20:42.415485+0000","last_active":"2024-04-25T15:20:43.406160+0000","last_peered":"2024-04-25T15:20:43.406160+0000","last_clean":"2024-04-25T15:20:43.406160+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:20:43.406160+0000","last_undegraded":"2024-04-25T15:20:43.406160+0000","last_fullsized":"2024-04-25T15:20:43.406160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:03.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616702+0000","last_change":"2024-04-25T15:20:41.406750+0000","last_active":"2024-04-25T15:20:43.616702+0000","last_peered":"2024-04-25T15:20:43.616702+0000","last_clean":"2024-04-25T15:20:43.616702+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:20:43.616702+0000","last_undegraded":"2024-04-25T15:20:43.616702+0000","last_fullsized":"2024-04-25T15:20:43.616702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404818+0000","last_change":"2024-04-25T15:20:42.423197+0000","last_active":"2024-04-25T15:20:43.404818+0000","last_peered":"2024-04-25T15:20:43.404818+0000","last_clean":"2024-04-25T15:20:43.404818+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:20:43.404818+0000","last_undegraded":"2024-04-25T15:20:43.404818+0000","last_fullsized":"2024-04-25T15:20:43.404818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616717+0000","last_change":"2024-04-25T15:20:41.401705+0000","last_active":"2024-04-25T15:20:43.616717+0000","last_peered":"2024-04-25T15:20:43.616717+0000","last_clean":"2024-04-25T15:20:43.616717+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:20:43.616717+0000","last_undegraded":"2024-04-25T15:20:43.616717+0000","last_fullsized":"2024-04-25T15:20:43.616717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616538+0000","last_change":"2024-04-25T15:20:42.416896+0000","last_active":"2024-04-25T15:20:43.616538+0000","last_peered":"2024-04-25T15:20:43.616538+0000","last_clean":"2024-04-25T15:20:43.616538+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:20:43.616538+0000","last_undegraded":"2024-04-25T15:20:43.616538+0000","last_fullsized":"2024-04-25T15:20:43.616538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616404+0000","last_change":"2024-04-25T15:20:41.409212+0000","last_active":"2024-04-25T15:20:43.616404+0000","last_peered":"2024-04-25T15:20:43.616404+0000","last_clean":"2024-04-25T15:20:43.616404+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:20:43.616404+0000","last_undegraded":"2024-04-25T15:20:43.616404+0000","last_fullsized":"2024-04-25T15:20:43.616404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406079+0000","last_change":"2024-04-25T15:20:42.412386+0000","last_active":"2024-04-25T15:20:43.406079+0000","last_peered":"2024-04-25T15:20:43.406079+0000","last_clean":"2024-04-25T15:20:43.406079+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:20:43.406079+0000","last_undegraded":"2024-04-25T15:20:43.406079+0000","last_fullsized":"2024-04-25T15:20:43.406079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:16.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615809+0000","last_change":"2024-04-25T15:20:41.402015+0000","last_active":"2024-04-25T15:20:43.615809+0000","last_peered":"2024-04-25T15:20:43.615809+0000","last_clean":"2024-04-25T15:20:43.615809+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:20:43.615809+0000","last_undegraded":"2024-04-25T15:20:43.615809+0000","last_fullsized":"2024-04-25T15:20:43.615809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615723+0000","last_change":"2024-04-25T15:20:42.418565+0000","last_active":"2024-04-25T15:20:43.615723+0000","last_peered":"2024-04-25T15:20:43.615723+0000","last_clean":"2024-04-25T15:20:43.615723+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:20:43.615723+0000","last_undegraded":"2024-04-25T15:20:43.615723+0000","last_fullsized":"2024-04-25T15:20:43.615723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615665+0000","last_change":"2024-04-25T15:20:41.408427+0000","last_active":"2024-04-25T15:20:43.615665+0000","last_peered":"2024-04-25T15:20:43.615665+0000","last_clean":"2024-04-25T15:20:43.615665+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:20:43.615665+0000","last_undegraded":"2024-04-25T15:20:43.615665+0000","last_fullsized":"2024-04-25T15:20:43.615665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405200+0000","last_change":"2024-04-25T15:20:42.415542+0000","last_active":"2024-04-25T15:20:43.405200+0000","last_peered":"2024-04-25T15:20:43.405200+0000","last_clean":"2024-04-25T15:20:43.405200+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:20:43.405200+0000","last_undegraded":"2024-04-25T15:20:43.405200+0000","last_fullsized":"2024-04-25T15:20:43.405200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:08.898090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405718+0000","last_change":"2024-04-25T15:20:41.405515+0000","last_active":"2024-04-25T15:20:43.405718+0000","last_peered":"2024-04-25T15:20:43.405718+0000","last_clean":"2024-04-25T15:20:43.405718+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:20:43.405718+0000","last_undegraded":"2024-04-25T15:20:43.405718+0000","last_fullsized":"2024-04-25T15:20:43.405718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406362+0000","last_change":"2024-04-25T15:20:42.412473+0000","last_active":"2024-04-25T15:20:43.406362+0000","last_peered":"2024-04-25T15:20:43.406362+0000","last_clean":"2024-04-25T15:20:43.406362+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:20:43.406362+0000","last_undegraded":"2024-04-25T15:20:43.406362+0000","last_fullsized":"2024-04-25T15:20:43.406362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:37.101862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616569+0000","last_change":"2024-04-25T15:20:41.406806+0000","last_active":"2024-04-25T15:20:43.616569+0000","last_peered":"2024-04-25T15:20:43.616569+0000","last_clean":"2024-04-25T15:20:43.616569+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:20:43.616569+0000","last_undegraded":"2024-04-25T15:20:43.616569+0000","last_fullsized":"2024-04-25T15:20:43.616569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405950+0000","last_change":"2024-04-25T15:20:42.414216+0000","last_active":"2024-04-25T15:20:43.405950+0000","last_peered":"2024-04-25T15:20:43.405950+0000","last_clean":"2024-04-25T15:20:43.405950+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:20:43.405950+0000","last_undegraded":"2024-04-25T15:20:43.405950+0000","last_fullsized":"2024-04-25T15:20:43.405950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:11.295712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401342+0000","last_change":"2024-04-25T15:20:41.410562+0000","last_active":"2024-04-25T15:20:43.401342+0000","last_peered":"2024-04-25T15:20:43.401342+0000","last_clean":"2024-04-25T15:20:43.401342+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:20:43.401342+0000","last_undegraded":"2024-04-25T15:20:43.401342+0000","last_fullsized":"2024-04-25T15:20:43.401342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616931+0000","last_change":"2024-04-25T15:20:42.424064+0000","last_active":"2024-04-25T15:20:43.616931+0000","last_peered":"2024-04-25T15:20:43.616931+0000","last_clean":"2024-04-25T15:20:43.616931+0000","last_became_active":"2024-04-25T15:20:42.422759+0000","last_became_peered":"2024-04-25T15:20:42.422759+0000","last_unstale":"2024-04-25T15:20:43.616931+0000","last_undegraded":"2024-04-25T15:20:43.616931+0000","last_fullsized":"2024-04-25T15:20:43.616931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:16.023260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615991+0000","last_change":"2024-04-25T15:20:41.404065+0000","last_active":"2024-04-25T15:20:43.615991+0000","last_peered":"2024-04-25T15:20:43.615991+0000","last_clean":"2024-04-25T15:20:43.615991+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:20:43.615991+0000","last_undegraded":"2024-04-25T15:20:43.615991+0000","last_fullsized":"2024-04-25T15:20:43.615991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405069+0000","last_change":"2024-04-25T15:20:42.422505+0000","last_active":"2024-04-25T15:20:43.405069+0000","last_peered":"2024-04-25T15:20:43.405069+0000","last_clean":"2024-04-25T15:20:43.405069+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:20:43.405069+0000","last_undegraded":"2024-04-25T15:20:43.405069+0000","last_fullsized":"2024-04-25T15:20:43.405069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:35.713134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404763+0000","last_change":"2024-04-25T15:20:30.873208+0000","last_active":"2024-04-25T15:20:43.404763+0000","last_peered":"2024-04-25T15:20:43.404763+0000","last_clean":"2024-04-25T15:20:43.404763+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:20:43.404763+0000","last_undegraded":"2024-04-25T15:20:43.404763+0000","last_fullsized":"2024-04-25T15:20:43.404763+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_clean_scrub_stamp":"2024-04-25T15:20:29.835147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:59.356200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615795+0000","last_change":"2024-04-25T15:20:41.403922+0000","last_active":"2024-04-25T15:20:43.615795+0000","last_peered":"2024-04-25T15:20:43.615795+0000","last_clean":"2024-04-25T15:20:43.615795+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:20:43.615795+0000","last_undegraded":"2024-04-25T15:20:43.615795+0000","last_fullsized":"2024-04-25T15:20:43.615795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616811+0000","last_change":"2024-04-25T15:20:42.432737+0000","last_active":"2024-04-25T15:20:43.616811+0000","last_peered":"2024-04-25T15:20:43.616811+0000","last_clean":"2024-04-25T15:20:43.616811+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:20:43.616811+0000","last_undegraded":"2024-04-25T15:20:43.616811+0000","last_fullsized":"2024-04-25T15:20:43.616811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:34.590315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405238+0000","last_change":"2024-04-25T15:20:41.410568+0000","last_active":"2024-04-25T15:20:43.405238+0000","last_peered":"2024-04-25T15:20:43.405238+0000","last_clean":"2024-04-25T15:20:43.405238+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:20:43.405238+0000","last_undegraded":"2024-04-25T15:20:43.405238+0000","last_fullsized":"2024-04-25T15:20:43.405238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616090+0000","last_change":"2024-04-25T15:20:42.410449+0000","last_active":"2024-04-25T15:20:43.616090+0000","last_peered":"2024-04-25T15:20:43.616090+0000","last_clean":"2024-04-25T15:20:43.616090+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:20:43.616090+0000","last_undegraded":"2024-04-25T15:20:43.616090+0000","last_fullsized":"2024-04-25T15:20:43.616090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:01.422318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615696+0000","last_change":"2024-04-25T15:20:41.406046+0000","last_active":"2024-04-25T15:20:43.615696+0000","last_peered":"2024-04-25T15:20:43.615696+0000","last_clean":"2024-04-25T15:20:43.615696+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:20:43.615696+0000","last_undegraded":"2024-04-25T15:20:43.615696+0000","last_fullsized":"2024-04-25T15:20:43.615696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.400998+0000","last_change":"2024-04-25T15:20:42.419446+0000","last_active":"2024-04-25T15:20:43.400998+0000","last_peered":"2024-04-25T15:20:43.400998+0000","last_clean":"2024-04-25T15:20:43.400998+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:20:43.400998+0000","last_undegraded":"2024-04-25T15:20:43.400998+0000","last_fullsized":"2024-04-25T15:20:43.400998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616445+0000","last_change":"2024-04-25T15:20:41.410676+0000","last_active":"2024-04-25T15:20:43.616445+0000","last_peered":"2024-04-25T15:20:43.616445+0000","last_clean":"2024-04-25T15:20:43.616445+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:20:43.616445+0000","last_undegraded":"2024-04-25T15:20:43.616445+0000","last_fullsized":"2024-04-25T15:20:43.616445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405821+0000","last_change":"2024-04-25T15:20:42.406333+0000","last_active":"2024-04-25T15:20:43.405821+0000","last_peered":"2024-04-25T15:20:43.405821+0000","last_clean":"2024-04-25T15:20:43.405821+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:20:43.405821+0000","last_undegraded":"2024-04-25T15:20:43.405821+0000","last_fullsized":"2024-04-25T15:20:43.405821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:33.466178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401234+0000","last_change":"2024-04-25T15:20:41.413703+0000","last_active":"2024-04-25T15:20:43.401234+0000","last_peered":"2024-04-25T15:20:43.401234+0000","last_clean":"2024-04-25T15:20:43.401234+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:20:43.401234+0000","last_undegraded":"2024-04-25T15:20:43.401234+0000","last_fullsized":"2024-04-25T15:20:43.401234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616898+0000","last_change":"2024-04-25T15:20:42.424028+0000","last_active":"2024-04-25T15:20:43.616898+0000","last_peered":"2024-04-25T15:20:43.616898+0000","last_clean":"2024-04-25T15:20:43.616898+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:20:43.616898+0000","last_undegraded":"2024-04-25T15:20:43.616898+0000","last_fullsized":"2024-04-25T15:20:43.616898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:11:26.290972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406206+0000","last_change":"2024-04-25T15:20:41.408759+0000","last_active":"2024-04-25T15:20:43.406206+0000","last_peered":"2024-04-25T15:20:43.406206+0000","last_clean":"2024-04-25T15:20:43.406206+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:20:43.406206+0000","last_undegraded":"2024-04-25T15:20:43.406206+0000","last_fullsized":"2024-04-25T15:20:43.406206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:41.992733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401262+0000","last_change":"2024-04-25T15:20:42.418890+0000","last_active":"2024-04-25T15:20:43.401262+0000","last_peered":"2024-04-25T15:20:43.401262+0000","last_clean":"2024-04-25T15:20:43.401262+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:20:43.401262+0000","last_undegraded":"2024-04-25T15:20:43.401262+0000","last_fullsized":"2024-04-25T15:20:43.401262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:21.116557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:44.420974+0000","last_change":"2024-04-25T15:20:41.409877+0000","last_active":"2024-04-25T15:20:44.420974+0000","last_peered":"2024-04-25T15:20:44.420974+0000","last_clean":"2024-04-25T15:20:44.420974+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:20:44.420974+0000","last_undegraded":"2024-04-25T15:20:44.420974+0000","last_fullsized":"2024-04-25T15:20:44.420974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616942+0000","last_change":"2024-04-25T15:20:42.428777+0000","last_active":"2024-04-25T15:20:43.616942+0000","last_peered":"2024-04-25T15:20:43.616942+0000","last_clean":"2024-04-25T15:20:43.616942+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:20:43.616942+0000","last_undegraded":"2024-04-25T15:20:43.616942+0000","last_fullsized":"2024-04-25T15:20:43.616942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:22:39.377037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616981+0000","last_change":"2024-04-25T15:20:41.410949+0000","last_active":"2024-04-25T15:20:43.616981+0000","last_peered":"2024-04-25T15:20:43.616981+0000","last_clean":"2024-04-25T15:20:43.616981+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:20:43.616981+0000","last_undegraded":"2024-04-25T15:20:43.616981+0000","last_fullsized":"2024-04-25T15:20:43.616981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616443+0000","last_change":"2024-04-25T15:20:42.413542+0000","last_active":"2024-04-25T15:20:43.616443+0000","last_peered":"2024-04-25T15:20:43.616443+0000","last_clean":"2024-04-25T15:20:43.616443+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:20:43.616443+0000","last_undegraded":"2024-04-25T15:20:43.616443+0000","last_fullsized":"2024-04-25T15:20:43.616443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.404657+0000","last_change":"2024-04-25T15:20:41.405078+0000","last_active":"2024-04-25T15:20:43.404657+0000","last_peered":"2024-04-25T15:20:43.404657+0000","last_clean":"2024-04-25T15:20:43.404657+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:20:43.404657+0000","last_undegraded":"2024-04-25T15:20:43.404657+0000","last_fullsized":"2024-04-25T15:20:43.404657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406027+0000","last_change":"2024-04-25T15:20:42.413408+0000","last_active":"2024-04-25T15:20:43.406027+0000","last_peered":"2024-04-25T15:20:43.406027+0000","last_clean":"2024-04-25T15:20:43.406027+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:20:43.406027+0000","last_undegraded":"2024-04-25T15:20:43.406027+0000","last_fullsized":"2024-04-25T15:20:43.406027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:37.360885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401097+0000","last_change":"2024-04-25T15:20:41.411766+0000","last_active":"2024-04-25T15:20:43.401097+0000","last_peered":"2024-04-25T15:20:43.401097+0000","last_clean":"2024-04-25T15:20:43.401097+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:20:43.401097+0000","last_undegraded":"2024-04-25T15:20:43.401097+0000","last_fullsized":"2024-04-25T15:20:43.401097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616281+0000","last_change":"2024-04-25T15:20:42.417444+0000","last_active":"2024-04-25T15:20:43.616281+0000","last_peered":"2024-04-25T15:20:43.616281+0000","last_clean":"2024-04-25T15:20:43.616281+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:20:43.616281+0000","last_undegraded":"2024-04-25T15:20:43.616281+0000","last_fullsized":"2024-04-25T15:20:43.616281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.401096+0000","last_change":"2024-04-25T15:20:41.406926+0000","last_active":"2024-04-25T15:20:43.401096+0000","last_peered":"2024-04-25T15:20:43.401096+0000","last_clean":"2024-04-25T15:20:43.401096+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:20:43.401096+0000","last_undegraded":"2024-04-25T15:20:43.401096+0000","last_fullsized":"2024-04-25T15:20:43.401096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616486+0000","last_change":"2024-04-25T15:20:42.422510+0000","last_active":"2024-04-25T15:20:43.616486+0000","last_peered":"2024-04-25T15:20:43.616486+0000","last_clean":"2024-04-25T15:20:43.616486+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:20:43.616486+0000","last_undegraded":"2024-04-25T15:20:43.616486+0000","last_fullsized":"2024-04-25T15:20:43.616486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:21:33.195879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.406194+0000","last_change":"2024-04-25T15:20:41.408140+0000","last_active":"2024-04-25T15:20:43.406194+0000","last_peered":"2024-04-25T15:20:43.406194+0000","last_clean":"2024-04-25T15:20:43.406194+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:20:43.406194+0000","last_undegraded":"2024-04-25T15:20:43.406194+0000","last_fullsized":"2024-04-25T15:20:43.406194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.615884+0000","last_change":"2024-04-25T15:20:42.421911+0000","last_active":"2024-04-25T15:20:43.615884+0000","last_peered":"2024-04-25T15:20:43.615884+0000","last_clean":"2024-04-25T15:20:43.615884+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:20:43.615884+0000","last_undegraded":"2024-04-25T15:20:43.615884+0000","last_fullsized":"2024-04-25T15:20:43.615884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:06.105171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616795+0000","last_change":"2024-04-25T15:20:42.421340+0000","last_active":"2024-04-25T15:20:43.616795+0000","last_peered":"2024-04-25T15:20:43.616795+0000","last_clean":"2024-04-25T15:20:43.616795+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:20:43.616795+0000","last_undegraded":"2024-04-25T15:20:43.616795+0000","last_fullsized":"2024-04-25T15:20:43.616795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:11.295712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405091+0000","last_change":"2024-04-25T15:20:41.408459+0000","last_active":"2024-04-25T15:20:43.405091+0000","last_peered":"2024-04-25T15:20:43.405091+0000","last_clean":"2024-04-25T15:20:43.405091+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:20:43.405091+0000","last_undegraded":"2024-04-25T15:20:43.405091+0000","last_fullsized":"2024-04-25T15:20:43.405091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616609+0000","last_change":"2024-04-25T15:20:42.421601+0000","last_active":"2024-04-25T15:20:43.616609+0000","last_peered":"2024-04-25T15:20:43.616609+0000","last_clean":"2024-04-25T15:20:43.616609+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:20:43.616609+0000","last_undegraded":"2024-04-25T15:20:43.616609+0000","last_fullsized":"2024-04-25T15:20:43.616609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:41.305637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.405989+0000","last_change":"2024-04-25T15:20:41.408914+0000","last_active":"2024-04-25T15:20:43.405989+0000","last_peered":"2024-04-25T15:20:43.405989+0000","last_clean":"2024-04-25T15:20:43.405989+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:20:43.405989+0000","last_undegraded":"2024-04-25T15:20:43.405989+0000","last_fullsized":"2024-04-25T15:20:43.405989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.598854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616433+0000","last_change":"2024-04-25T15:20:42.423383+0000","last_active":"2024-04-25T15:20:43.616433+0000","last_peered":"2024-04-25T15:20:43.616433+0000","last_clean":"2024-04-25T15:20:43.616433+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:20:43.616433+0000","last_undegraded":"2024-04-25T15:20:43.616433+0000","last_fullsized":"2024-04-25T15:20:43.616433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:21.393610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616854+0000","last_change":"2024-04-25T15:20:41.405976+0000","last_active":"2024-04-25T15:20:43.616854+0000","last_peered":"2024-04-25T15:20:43.616854+0000","last_clean":"2024-04-25T15:20:43.616854+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:20:43.616854+0000","last_undegraded":"2024-04-25T15:20:43.616854+0000","last_fullsized":"2024-04-25T15:20:43.616854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616697+0000","last_change":"2024-04-25T15:20:42.429601+0000","last_active":"2024-04-25T15:20:43.616697+0000","last_peered":"2024-04-25T15:20:43.616697+0000","last_clean":"2024-04-25T15:20:43.616697+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:20:43.616697+0000","last_undegraded":"2024-04-25T15:20:43.616697+0000","last_fullsized":"2024-04-25T15:20:43.616697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:57:55.221509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T15:20:43.616853+0000","last_change":"2024-04-25T15:20:41.410750+0000","last_active":"2024-04-25T15:20:43.616853+0000","last_peered":"2024-04-25T15:20:43.616853+0000","last_clean":"2024-04-25T15:20:43.616853+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:20:43.616853+0000","last_undegraded":"2024-04-25T15:20:43.616853+0000","last_fullsized":"2024-04-25T15:20:43.616853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:20:51.519 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T15:20:51.519 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T15:20:51.519 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T15:20:51.519 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T15:20:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.663+0000 7fdf0c900640 1 Processor -- start 2024-04-25T15:20:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.663+0000 7fdf0c900640 1 -- start start 2024-04-25T15:20:51.669 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0c900640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf08147c50 0x7fdf08148060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0c900640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf080b3c50 con 0x7fdf08070550 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0c900640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf080b1a70 con 0x7fdf0814ff80 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0c900640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf080b8730 con 0x7fdf08147c50 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0659c640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdf08070550 0x7fdf080b1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45302/0 (socket says 172.21.15.33:45302) 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0659c640 1 -- 172.21.15.33:0/3843117013 learned_addr learned my addr 172.21.15.33:0/3843117013 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812210722 0 0) 0x7fdf080b3c50 con 0x7fdf08070550 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdef4003520 con 0x7fdf08070550 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf05d9b640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf08147c50 0x7fdf08148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2811248696 0 0) 0x7fdef4003520 con 0x7fdf08070550 2024-04-25T15:20:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf08147c50 msgr2=0x7fdf08148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf08147c50 0x7fdf08148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 >> v1:172.21.15.155:6789/0 conn(0x7fdf0814ff80 legacy=0x7fdf081523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf080b8980 con 0x7fdf08070550 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7fdef80019f0 con 0x7fdf08070550 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 >> v1:172.21.15.33:6789/0 conn(0x7fdf08070550 legacy=0x7fdf080b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdef4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf08147c50 0x7fdef4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef4004e60 0x7fdef40052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdf080b8730 con 0x7fdef40039e0 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdef400bce0 con 0x7fdef4004e60 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.665+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdef400bee0 con 0x7fdf08147c50 2024-04-25T15:20:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.666+0000 7fdf0659c640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdef4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.666+0000 7fdf05d9b640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf08147c50 0x7fdef4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.666+0000 7fdf06d9d640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef4004e60 0x7fdef40052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.666+0000 7fdf0659c640 1 -- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf08147c50 msgr2=0x7fdef4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.666+0000 7fdf0659c640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf08147c50 0x7fdef4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.666+0000 7fdf0659c640 1 -- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef4004e60 msgr2=0x7fdef40052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.666+0000 7fdf0659c640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdef4004e60 0x7fdef40052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.666+0000 7fdf0659c640 1 -- 172.21.15.33:0/3843117013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef4003520 con 0x7fdef40039e0 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.667+0000 7fdf0659c640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdef4003e50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdef800a840 tx=0x7fdef4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e3df836342440a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.667+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef800a460 con 0x7fdef40039e0 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.667+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef802f070 con 0x7fdef40039e0 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.667+0000 7fdf0559a640 1 -- 172.21.15.33:0/3843117013 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef802bcb0 con 0x7fdef40039e0 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.667+0000 7fdf0c900640 1 -- 172.21.15.33:0/3843117013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 msgr2=0x7fdef4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.667+0000 7fdf0c900640 1 --2- 172.21.15.33:0/3843117013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdef4003e50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdef800a840 tx=0x7fdef4005830 comp rx=0 tx=0).stop 2024-04-25T15:20:51.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.667+0000 7fdf06d9d640 1 -- 172.21.15.33:0/3843117013 reap_dead start 2024-04-25T15:20:51.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.668+0000 7fdf0c900640 1 -- 172.21.15.33:0/3843117013 shutdown_connections 2024-04-25T15:20:51.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.668+0000 7fdf0c900640 1 -- 172.21.15.33:0/3843117013 >> 172.21.15.33:0/3843117013 conn(0x7fdf08063ad0 msgr2=0x7fdf080bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:51.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.668+0000 7fdf0c900640 1 -- 172.21.15.33:0/3843117013 shutdown_connections 2024-04-25T15:20:51.673 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.668+0000 7fdf0c900640 1 -- 172.21.15.33:0/3843117013 wait complete. 2024-04-25T15:20:51.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.669+0000 7fdf0c900640 1 Processor -- start 2024-04-25T15:20:51.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.669+0000 7fdf0c900640 1 -- start start 2024-04-25T15:20:51.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0c900640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdf0814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0c900640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf081489a0 0x7fdf081400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0c900640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf081405f0 0x7fdf081e0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0c900640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fdf080b3270 con 0x7fdef40039e0 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0c900640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf080b8cf0 con 0x7fdf081405f0 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0c900640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf08071990 con 0x7fdf081489a0 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdf0814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0659c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdf0814bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51488/0 (socket says 172.21.15.33:51488) 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.670+0000 7fdf0659c640 1 -- 172.21.15.33:0/3332554135 learned_addr learned my addr 172.21.15.33:0/3332554135 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf05d9b640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf081489a0 0x7fdf081400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf06d9d640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf081405f0 0x7fdf081e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf0659c640 1 -- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf081489a0 msgr2=0x7fdf081400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf0659c640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf081489a0 0x7fdf081400b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.677 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf0659c640 1 -- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf081405f0 msgr2=0x7fdf081e0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf0659c640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf081405f0 0x7fdf081e0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf0659c640 1 -- 172.21.15.33:0/3332554135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0814d920 con 0x7fdef40039e0 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf06d9d640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf081405f0 0x7fdf081e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf0659c640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdf0814bfa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdef8001cf0 tx=0x7fdf080b8c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdefeffd640 1 -- 172.21.15.33:0/3332554135 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef802bc60 con 0x7fdef40039e0 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdefeffd640 1 -- 172.21.15.33:0/3332554135 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef802be00 con 0x7fdef40039e0 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0814b150 con 0x7fdef40039e0 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdefeffd640 1 -- 172.21.15.33:0/3332554135 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8034690 con 0x7fdef40039e0 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.671+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf081490f0 con 0x7fdef40039e0 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.672+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf08149350 con 0x7fdef40039e0 2024-04-25T15:20:51.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.673+0000 7fdefeffd640 1 -- 172.21.15.33:0/3332554135 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdef8034830 con 0x7fdef40039e0 2024-04-25T15:20:51.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.673+0000 7fdefeffd640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdee80744b0 0x7fdee80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:51.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.673+0000 7fdefeffd640 1 -- 172.21.15.33:0/3332554135 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdef80b5730 con 0x7fdef40039e0 2024-04-25T15:20:51.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.673+0000 7fdf05d9b640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdee80744b0 0x7fdee80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:51.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.674+0000 7fdf05d9b640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdee80744b0 0x7fdee80769c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdf081438c0 tx=0x7fdef0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:51.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.678+0000 7fdefeffd640 1 -- 172.21.15.33:0/3332554135 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdef807fec0 con 0x7fdef40039e0 2024-04-25T15:20:51.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.907+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdf080764e0 con 0x7fdef40039e0 2024-04-25T15:20:51.909 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.908+0000 7fdefeffd640 1 -- 172.21.15.33:0/3332554135 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fdef807f7c0 con 0x7fdef40039e0 2024-04-25T15:20:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:51.909 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdee80744b0 msgr2=0x7fdee80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdee80744b0 0x7fdee80769c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdf081438c0 tx=0x7fdef0008040 comp rx=0 tx=0).stop 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 msgr2=0x7fdf0814bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdf0814bfa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdef8001cf0 tx=0x7fdf080b8c60 comp rx=0 tx=0).stop 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 shutdown_connections 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fdee80744b0 0x7fdee80769c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf081405f0 0x7fdf081e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf081489a0 0x7fdf081400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 --2- 172.21.15.33:0/3332554135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdef40039e0 0x7fdf0814bfa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 >> 172.21.15.33:0/3332554135 conn(0x7fdf08063ad0 msgr2=0x7fdf080b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 shutdown_connections 2024-04-25T15:20:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:51.910+0000 7fdf0c900640 1 -- 172.21.15.33:0/3332554135 wait complete. 2024-04-25T15:20:51.922 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T15:20:51.923 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:52.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.033+0000 7f24a4651640 1 Processor -- start 2024-04-25T15:20:52.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.033+0000 7f24a4651640 1 -- start start 2024-04-25T15:20:52.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.034+0000 7f24a4651640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.034+0000 7f24a4651640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249c149d40 con 0x7f249c0be4f0 2024-04-25T15:20:52.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.034+0000 7f24a4651640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249c14a020 con 0x7f249c0be0e0 2024-04-25T15:20:52.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.034+0000 7f24a4651640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f249c14a820 con 0x7f249c149840 2024-04-25T15:20:52.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a2bee640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f249c0be4f0 0x7f249c09d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45308/0 (socket says 172.21.15.33:45308) 2024-04-25T15:20:52.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a2bee640 1 -- 172.21.15.33:0/1651070093 learned_addr learned my addr 172.21.15.33:0/1651070093 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:52.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a23ed640 1 --2- 172.21.15.33:0/1651070093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a13eb640 1 -- 172.21.15.33:0/1651070093 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582662776 0 0) 0x7f249c149d40 con 0x7f249c0be4f0 2024-04-25T15:20:52.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a13eb640 1 -- 172.21.15.33:0/1651070093 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2484003520 con 0x7f249c0be4f0 2024-04-25T15:20:52.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a13eb640 1 -- 172.21.15.33:0/1651070093 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056004826 0 0) 0x7f249c14a020 con 0x7f249c0be0e0 2024-04-25T15:20:52.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a13eb640 1 -- 172.21.15.33:0/1651070093 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f249c149d40 con 0x7f249c0be0e0 2024-04-25T15:20:52.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a13eb640 1 -- 172.21.15.33:0/1651070093 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1560458269 0 0) 0x7f2484003520 con 0x7f249c0be4f0 2024-04-25T15:20:52.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a23ed640 1 -- 172.21.15.33:0/1651070093 >> v1:172.21.15.155:6789/0 conn(0x7f249c0be0e0 legacy=0x7f249c0bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a23ed640 1 -- 172.21.15.33:0/1651070093 >> v1:172.21.15.33:6789/0 conn(0x7f249c0be4f0 legacy=0x7f249c09d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.035+0000 7f24a23ed640 1 -- 172.21.15.33:0/1651070093 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c14a300 con 0x7f249c149840 2024-04-25T15:20:52.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.036+0000 7f24a23ed640 1 --2- 172.21.15.33:0/1651070093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c06d230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f248c009dc0 tx=0x7f248c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9421a7558a5d82b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.036+0000 7f24a13eb640 1 -- 172.21.15.33:0/1651070093 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494001670 con 0x7f249c149840 2024-04-25T15:20:52.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.036+0000 7f24a13eb640 1 -- 172.21.15.33:0/1651070093 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c007540 con 0x7f249c149840 2024-04-25T15:20:52.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.036+0000 7f24a13eb640 1 -- 172.21.15.33:0/1651070093 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0078f0 con 0x7f249c149840 2024-04-25T15:20:52.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.037+0000 7f24a4651640 1 -- 172.21.15.33:0/1651070093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 msgr2=0x7f249c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.037+0000 7f24a4651640 1 --2- 172.21.15.33:0/1651070093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c06d230 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f248c009dc0 tx=0x7f248c02a660 comp rx=0 tx=0).stop 2024-04-25T15:20:52.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.037+0000 7f24a4651640 1 -- 172.21.15.33:0/1651070093 shutdown_connections 2024-04-25T15:20:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.037+0000 7f24a4651640 1 --2- 172.21.15.33:0/1651070093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c06d230 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.037+0000 7f24a4651640 1 -- 172.21.15.33:0/1651070093 >> 172.21.15.33:0/1651070093 conn(0x7f249c0bebf0 msgr2=0x7f249c0bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.037+0000 7f24a4651640 1 -- 172.21.15.33:0/1651070093 shutdown_connections 2024-04-25T15:20:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.037+0000 7f24a4651640 1 -- 172.21.15.33:0/1651070093 wait complete. 2024-04-25T15:20:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.038+0000 7f24a4651640 1 Processor -- start 2024-04-25T15:20:52.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.039+0000 7f24a4651640 1 -- start start 2024-04-25T15:20:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.039+0000 7f24a4651640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0be0e0 0x7f249c0b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.039+0000 7f24a4651640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f249c0be4f0 0x7f249c0a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.039+0000 7f24a4651640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c1dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.039+0000 7f24a4651640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f249c09dc70 con 0x7f249c0be0e0 2024-04-25T15:20:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a4651640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f249c09daf0 con 0x7f249c0be4f0 2024-04-25T15:20:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a4651640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f249c1df7c0 con 0x7f249c149840 2024-04-25T15:20:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0be0e0 0x7f249c0b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0be0e0 0x7f249c0b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51500/0 (socket says 172.21.15.33:51500) 2024-04-25T15:20:52.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 -- 172.21.15.33:0/2263912798 learned_addr learned my addr 172.21.15.33:0/2263912798 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:52.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 -- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 msgr2=0x7f249c1dfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a2bee640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c1dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a1bec640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f249c0be4f0 0x7f249c0a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c1dfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 -- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f249c0be4f0 msgr2=0x7f249c0a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f249c0be4f0 0x7f249c0a2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 -- 172.21.15.33:0/2263912798 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c0a25d0 con 0x7f249c0be0e0 2024-04-25T15:20:52.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a23ed640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0be0e0 0x7f249c0b85a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f248c02ac50 tx=0x7f248c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f249affd640 1 -- 172.21.15.33:0/2263912798 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c009450 con 0x7f249c0be0e0 2024-04-25T15:20:52.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f249affd640 1 -- 172.21.15.33:0/2263912798 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c004450 con 0x7f249c0be0e0 2024-04-25T15:20:52.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c0a4900 con 0x7f249c0be0e0 2024-04-25T15:20:52.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f249affd640 1 -- 172.21.15.33:0/2263912798 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c004800 con 0x7f249c0be0e0 2024-04-25T15:20:52.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.040+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c0a1b70 con 0x7f249c0be0e0 2024-04-25T15:20:52.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.041+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c0a27a0 con 0x7f249c0be0e0 2024-04-25T15:20:52.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.042+0000 7f249affd640 1 -- 172.21.15.33:0/2263912798 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f248c039040 con 0x7f249c0be0e0 2024-04-25T15:20:52.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.042+0000 7f249affd640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f24880744b0 0x7f24880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.042+0000 7f249affd640 1 -- 172.21.15.33:0/2263912798 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f248c0b6500 con 0x7f249c0be0e0 2024-04-25T15:20:52.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.043+0000 7f24a1bec640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f24880744b0 0x7f24880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.043+0000 7f24a1bec640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f24880744b0 0x7f24880769c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f249c147310 tx=0x7f2490009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.047+0000 7f249affd640 1 -- 172.21.15.33:0/2263912798 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f249c0a27a0 con 0x7f249c0be0e0 2024-04-25T15:20:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.231+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f249c0764e0 con 0x7f249c0be0e0 2024-04-25T15:20:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.232+0000 7f249affd640 1 -- 172.21.15.33:0/2263912798 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f248c040030 con 0x7f249c0be0e0 2024-04-25T15:20:52.235 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:52.235 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:43.397488+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:52.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f24880744b0 msgr2=0x7f24880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f24880744b0 0x7f24880769c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f249c147310 tx=0x7f2490009040 comp rx=0 tx=0).stop 2024-04-25T15:20:52.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0be0e0 msgr2=0x7f249c0b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0be0e0 0x7f249c0b85a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f248c02ac50 tx=0x7f248c004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 shutdown_connections 2024-04-25T15:20:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f24880744b0 0x7f24880769c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f249c149840 0x7f249c1dfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f249c0be4f0 0x7f249c0a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 --2- 172.21.15.33:0/2263912798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f249c0be0e0 0x7f249c0b85a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 >> 172.21.15.33:0/2263912798 conn(0x7f249c0bebf0 msgr2=0x7f249c0bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:52.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 shutdown_connections 2024-04-25T15:20:52.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.234+0000 7f24a4651640 1 -- 172.21.15.33:0/2263912798 wait complete. 2024-04-25T15:20:52.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:20:29.721824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:20:39.967842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:20:40.725695+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:20:52.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:20:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.362+0000 7f06e2d2e640 1 Processor -- start 2024-04-25T15:20:52.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.362+0000 7f06e2d2e640 1 -- start start 2024-04-25T15:20:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06e2d2e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f06dc149800 0x7f06dc0b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06e2d2e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06dc073870 0x7f06dc071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06e2d2e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06dc149d90 con 0x7f06dc0722e0 2024-04-25T15:20:52.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06e2d2e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f06dc0726f0 con 0x7f06dc073870 2024-04-25T15:20:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06e2d2e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f06dc14a070 con 0x7f06dc149800 2024-04-25T15:20:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06dbfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06dc073870 0x7f06dc071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06e12cb640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f06dc0722e0 0x7f06dc143560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45318/0 (socket says 172.21.15.33:45318) 2024-04-25T15:20:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06e12cb640 1 -- 172.21.15.33:0/2397376353 learned_addr learned my addr 172.21.15.33:0/2397376353 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06e0aca640 1 --2- 172.21.15.33:0/2397376353 >> v2:172.21.15.155:3300/0 conn(0x7f06dc149800 0x7f06dc0b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06dbfff640 1 -- 172.21.15.33:0/2397376353 >> v2:172.21.15.155:3300/0 conn(0x7f06dc149800 msgr2=0x7f06dc0b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06dbfff640 1 --2- 172.21.15.33:0/2397376353 >> v2:172.21.15.155:3300/0 conn(0x7f06dc149800 0x7f06dc0b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06dbfff640 1 -- 172.21.15.33:0/2397376353 >> v1:172.21.15.33:6789/0 conn(0x7f06dc0722e0 legacy=0x7f06dc143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06dbfff640 1 -- 172.21.15.33:0/2397376353 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc14a350 con 0x7f06dc073870 2024-04-25T15:20:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.363+0000 7f06db7fe640 1 -- 172.21.15.33:0/2397376353 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404154210 0 0) 0x7f06dc149d90 con 0x7f06dc0722e0 2024-04-25T15:20:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.364+0000 7f06dbfff640 1 --2- 172.21.15.33:0/2397376353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc073870 0x7f06dc071da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06dc071100 tx=0x7f06d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41f45541186cc3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.364+0000 7f06db7fe640 1 -- 172.21.15.33:0/2397376353 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0037070 con 0x7f06dc073870 2024-04-25T15:20:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.364+0000 7f06db7fe640 1 -- 172.21.15.33:0/2397376353 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d0032440 con 0x7f06dc073870 2024-04-25T15:20:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.364+0000 7f06db7fe640 1 -- 172.21.15.33:0/2397376353 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0032810 con 0x7f06dc073870 2024-04-25T15:20:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.365+0000 7f06e2d2e640 1 -- 172.21.15.33:0/2397376353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc073870 msgr2=0x7f06dc071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.365+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/2397376353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc073870 0x7f06dc071da0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06dc071100 tx=0x7f06d002a1a0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.365+0000 7f06e2d2e640 1 -- 172.21.15.33:0/2397376353 shutdown_connections 2024-04-25T15:20:52.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.365+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/2397376353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc073870 0x7f06dc071da0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.365+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/2397376353 >> v2:172.21.15.155:3300/0 conn(0x7f06dc149800 0x7f06dc0b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.365+0000 7f06e2d2e640 1 -- 172.21.15.33:0/2397376353 >> 172.21.15.33:0/2397376353 conn(0x7f06dc0bb2e0 msgr2=0x7f06dc0bb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.365+0000 7f06e2d2e640 1 -- 172.21.15.33:0/2397376353 shutdown_connections 2024-04-25T15:20:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.365+0000 7f06e2d2e640 1 -- 172.21.15.33:0/2397376353 wait complete. 2024-04-25T15:20:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.366+0000 7f06e2d2e640 1 Processor -- start 2024-04-25T15:20:52.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.366+0000 7f06e2d2e640 1 -- start start 2024-04-25T15:20:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.367+0000 7f06e2d2e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06dc0722e0 0x7f06dc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.367+0000 7f06e2d2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06dc073870 0x7f06dc13f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e2d2e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc149800 0x7f06dc1402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e2d2e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc143df0 con 0x7f06dc149800 2024-04-25T15:20:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e2d2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc143c70 con 0x7f06dc073870 2024-04-25T15:20:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e2d2e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f06dc143f70 con 0x7f06dc0722e0 2024-04-25T15:20:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc149800 0x7f06dc1402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc149800 0x7f06dc1402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51514/0 (socket says 172.21.15.33:51514) 2024-04-25T15:20:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 -- 172.21.15.33:0/1642034276 learned_addr learned my addr 172.21.15.33:0/1642034276 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06dbfff640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06dc073870 0x7f06dc13f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e0aca640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06dc0722e0 0x7f06dc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 -- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06dc0722e0 msgr2=0x7f06dc0b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06dc0722e0 0x7f06dc0b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 -- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06dc073870 msgr2=0x7f06dc13f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06dc073870 0x7f06dc13f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 -- 172.21.15.33:0/1642034276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc13fde0 con 0x7f06dc149800 2024-04-25T15:20:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e0aca640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06dc0722e0 0x7f06dc0b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06dbfff640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06dc073870 0x7f06dc13f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e12cb640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc149800 0x7f06dc1402b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c3e0 tx=0x7f06cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06d97fa640 1 -- 172.21.15.33:0/1642034276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0074e0 con 0x7f06dc149800 2024-04-25T15:20:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06d97fa640 1 -- 172.21.15.33:0/1642034276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0047e0 con 0x7f06dc149800 2024-04-25T15:20:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06d97fa640 1 -- 172.21.15.33:0/1642034276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc004bd0 con 0x7f06dc149800 2024-04-25T15:20:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc0b4900 con 0x7f06dc149800 2024-04-25T15:20:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.368+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc13fff0 con 0x7f06dc149800 2024-04-25T15:20:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.370+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06dc0764e0 con 0x7f06dc149800 2024-04-25T15:20:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.370+0000 7f06d97fa640 1 -- 172.21.15.33:0/1642034276 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f06cc011070 con 0x7f06dc149800 2024-04-25T15:20:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.370+0000 7f06d97fa640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f06c80744b0 0x7f06c80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.370+0000 7f06d97fa640 1 -- 172.21.15.33:0/1642034276 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f06cc094d50 con 0x7f06dc149800 2024-04-25T15:20:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.371+0000 7f06e0aca640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f06c80744b0 0x7f06c80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.371+0000 7f06e0aca640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f06c80744b0 0x7f06c80769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f06d4007440 tx=0x7f06d400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.375+0000 7f06d97fa640 1 -- 172.21.15.33:0/1642034276 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f06cc098030 con 0x7f06dc149800 2024-04-25T15:20:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.562+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f06dc0b7780 con 0x7f06dc149800 2024-04-25T15:20:52.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.562+0000 7f06d97fa640 1 -- 172.21.15.33:0/1642034276 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f06cc05f570 con 0x7f06dc149800 2024-04-25T15:20:52.564 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-04-25T15:20:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f06c80744b0 msgr2=0x7f06c80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f06c80744b0 0x7f06c80769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f06d4007440 tx=0x7f06d400b040 comp rx=0 tx=0).stop 2024-04-25T15:20:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc149800 msgr2=0x7f06dc1402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc149800 0x7f06dc1402b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c3e0 tx=0x7f06cc00c8a0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 shutdown_connections 2024-04-25T15:20:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f06c80744b0 0x7f06c80769c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06dc149800 0x7f06dc1402b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06dc073870 0x7f06dc13f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 --2- 172.21.15.33:0/1642034276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06dc0722e0 0x7f06dc0b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 >> 172.21.15.33:0/1642034276 conn(0x7f06dc0bb2e0 msgr2=0x7f06dc0bb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 shutdown_connections 2024-04-25T15:20:52.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.564+0000 7f06e2d2e640 1 -- 172.21.15.33:0/1642034276 wait complete. 2024-04-25T15:20:52.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:20:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.688+0000 7fd98fe69640 1 Processor -- start 2024-04-25T15:20:52.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.689+0000 7fd98fe69640 1 -- start start 2024-04-25T15:20:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98fe69640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd988149840 0x7fd98806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98fe69640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9880be4f0 0x7fd98809d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98fe69640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd988149d40 con 0x7fd9880be0e0 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98fe69640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fd98814a820 con 0x7fd9880be4f0 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98fe69640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd98814a020 con 0x7fd988149840 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98e406640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9880be4f0 0x7fd98809d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98e406640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9880be4f0 0x7fd98809d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51520/0 (socket says 172.21.15.33:51520) 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98e406640 1 -- 172.21.15.33:0/3095552448 learned_addr learned my addr 172.21.15.33:0/3095552448 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98dc05640 1 --2- 172.21.15.33:0/3095552448 >> v2:172.21.15.155:3300/0 conn(0x7fd988149840 0x7fd98806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98e406640 1 -- 172.21.15.33:0/3095552448 >> v2:172.21.15.155:3300/0 conn(0x7fd988149840 msgr2=0x7fd98806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98e406640 1 --2- 172.21.15.33:0/3095552448 >> v2:172.21.15.155:3300/0 conn(0x7fd988149840 0x7fd98806d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98e406640 1 -- 172.21.15.33:0/3095552448 >> v1:172.21.15.33:6789/0 conn(0x7fd9880be0e0 legacy=0x7fd9880bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.690+0000 7fd98e406640 1 -- 172.21.15.33:0/3095552448 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98814a300 con 0x7fd9880be4f0 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.691+0000 7fd98e406640 1 --2- 172.21.15.33:0/3095552448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9880be4f0 0x7fd98809d3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd98806f1c0 tx=0x7fd98002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b6d10ad1d386c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.691+0000 7fd98cc03640 1 -- 172.21.15.33:0/3095552448 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980036070 con 0x7fd9880be4f0 2024-04-25T15:20:52.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.691+0000 7fd98cc03640 1 -- 172.21.15.33:0/3095552448 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd980031600 con 0x7fd9880be4f0 2024-04-25T15:20:52.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.691+0000 7fd98cc03640 1 -- 172.21.15.33:0/3095552448 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9800319d0 con 0x7fd9880be4f0 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.692+0000 7fd98fe69640 1 -- 172.21.15.33:0/3095552448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9880be4f0 msgr2=0x7fd98809d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.692+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3095552448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9880be4f0 0x7fd98809d3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd98806f1c0 tx=0x7fd98002a730 comp rx=0 tx=0).stop 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.692+0000 7fd98fe69640 1 -- 172.21.15.33:0/3095552448 shutdown_connections 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.692+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3095552448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9880be4f0 0x7fd98809d3e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.692+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3095552448 >> v2:172.21.15.155:3300/0 conn(0x7fd988149840 0x7fd98806d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.692+0000 7fd98fe69640 1 -- 172.21.15.33:0/3095552448 >> 172.21.15.33:0/3095552448 conn(0x7fd9880bebf0 msgr2=0x7fd9880bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.692+0000 7fd98fe69640 1 -- 172.21.15.33:0/3095552448 shutdown_connections 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.692+0000 7fd98fe69640 1 -- 172.21.15.33:0/3095552448 wait complete. 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.693+0000 7fd98fe69640 1 Processor -- start 2024-04-25T15:20:52.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.694+0000 7fd98fe69640 1 -- start start 2024-04-25T15:20:52.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.694+0000 7fd98fe69640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9880be0e0 0x7fd9880b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.694+0000 7fd98fe69640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9880be4f0 0x7fd9881e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.694+0000 7fd98fe69640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd988149840 0x7fd988146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.694+0000 7fd98fe69640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fd98809daa0 con 0x7fd988149840 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98fe69640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd98809d920 con 0x7fd9880be4f0 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98fe69640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd98809dc20 con 0x7fd9880be0e0 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd988149840 0x7fd988146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd988149840 0x7fd988146770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51534/0 (socket says 172.21.15.33:51534) 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 -- 172.21.15.33:0/3239659488 learned_addr learned my addr 172.21.15.33:0/3239659488 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98d404640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9880be4f0 0x7fd9881e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98dc05640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9880be0e0 0x7fd9880b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 -- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9880be0e0 msgr2=0x7fd9880b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9880be0e0 0x7fd9880b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.698 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 -- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9880be4f0 msgr2=0x7fd9881e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9880be4f0 0x7fd9881e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 -- 172.21.15.33:0/3239659488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9880a4b00 con 0x7fd988149840 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98e406640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd988149840 0x7fd988146770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd980009f40 tx=0x7fd980004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd97e7fc640 1 -- 172.21.15.33:0/3239659488 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980036050 con 0x7fd988149840 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd97e7fc640 1 -- 172.21.15.33:0/3239659488 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd980042070 con 0x7fd988149840 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9881e3510 con 0x7fd988149840 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd97e7fc640 1 -- 172.21.15.33:0/3239659488 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd980009510 con 0x7fd988149840 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.695+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9880a4200 con 0x7fd988149840 2024-04-25T15:20:52.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.696+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9880764e0 con 0x7fd988149840 2024-04-25T15:20:52.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.697+0000 7fd97e7fc640 1 -- 172.21.15.33:0/3239659488 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd980007bf0 con 0x7fd988149840 2024-04-25T15:20:52.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.697+0000 7fd97e7fc640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd96c0744b0 0x7fd96c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:52.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.698+0000 7fd97e7fc640 1 -- 172.21.15.33:0/3239659488 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd9800b5f90 con 0x7fd988149840 2024-04-25T15:20:52.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.698+0000 7fd98dc05640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd96c0744b0 0x7fd96c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:52.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.698+0000 7fd98dc05640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd96c0744b0 0x7fd96c0769c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd984006fd0 tx=0x7fd984008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:52.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.702+0000 7fd97e7fc640 1 -- 172.21.15.33:0/3239659488 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd9800807b0 con 0x7fd988149840 2024-04-25T15:20:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.889+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd9880a4900 con 0x7fd988149840 2024-04-25T15:20:52.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.890+0000 7fd97e7fc640 1 -- 172.21.15.33:0/3239659488 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fd9800800b0 con 0x7fd988149840 2024-04-25T15:20:52.892 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd96c0744b0 msgr2=0x7fd96c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd96c0744b0 0x7fd96c0769c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd984006fd0 tx=0x7fd984008040 comp rx=0 tx=0).stop 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd988149840 msgr2=0x7fd988146770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd988149840 0x7fd988146770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd980009f40 tx=0x7fd980004a40 comp rx=0 tx=0).stop 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 shutdown_connections 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fd96c0744b0 0x7fd96c0769c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd988149840 0x7fd988146770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9880be4f0 0x7fd9881e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 --2- 172.21.15.33:0/3239659488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9880be0e0 0x7fd9880b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 >> 172.21.15.33:0/3239659488 conn(0x7fd9880bebf0 msgr2=0x7fd98809cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:52.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 shutdown_connections 2024-04-25T15:20:52.895 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:52.892+0000 7fd98fe69640 1 -- 172.21.15.33:0/3239659488 wait complete. 2024-04-25T15:20:52.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:20:53.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.016+0000 7f4e270f2640 1 Processor -- start 2024-04-25T15:20:53.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.016+0000 7f4e270f2640 1 -- start start 2024-04-25T15:20:53.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.017+0000 7f4e270f2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4e200b9570 0x7f4e2006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.017+0000 7f4e270f2640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4e200ba490 0x7f4e200be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.017+0000 7f4e270f2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e200b99b0 con 0x7f4e2014cd40 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.017+0000 7f4e270f2640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f4e200b9c90 con 0x7f4e200ba490 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.017+0000 7f4e270f2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4e200b9f70 con 0x7f4e200b9570 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.018+0000 7f4e1ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4e200ba490 0x7f4e200be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.018+0000 7f4e1ffff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4e200ba490 0x7f4e200be070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51538/0 (socket says 172.21.15.33:51538) 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.018+0000 7f4e1ffff640 1 -- 172.21.15.33:0/2825891714 learned_addr learned my addr 172.21.15.33:0/2825891714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.018+0000 7f4e24e8e640 1 --2- 172.21.15.33:0/2825891714 >> v2:172.21.15.155:3300/0 conn(0x7f4e200b9570 0x7f4e2006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.018+0000 7f4e1ffff640 1 -- 172.21.15.33:0/2825891714 >> v2:172.21.15.155:3300/0 conn(0x7f4e200b9570 msgr2=0x7f4e2006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.018+0000 7f4e1ffff640 1 --2- 172.21.15.33:0/2825891714 >> v2:172.21.15.155:3300/0 conn(0x7f4e200b9570 0x7f4e2006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.018+0000 7f4e1ffff640 1 -- 172.21.15.33:0/2825891714 >> v1:172.21.15.155:6789/0 conn(0x7f4e2014cd40 legacy=0x7f4e2009d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.018+0000 7f4e1ffff640 1 -- 172.21.15.33:0/2825891714 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e200be5b0 con 0x7f4e200ba490 2024-04-25T15:20:53.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.019+0000 7f4e1ffff640 1 --2- 172.21.15.33:0/2825891714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200ba490 0x7f4e200be070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006f1c0 tx=0x7f4e1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1669aa9b0cd8fa72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.019+0000 7f4e1f7fe640 1 -- 172.21.15.33:0/2825891714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14037070 con 0x7f4e200ba490 2024-04-25T15:20:53.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.019+0000 7f4e1f7fe640 1 -- 172.21.15.33:0/2825891714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e14032440 con 0x7f4e200ba490 2024-04-25T15:20:53.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.019+0000 7f4e1f7fe640 1 -- 172.21.15.33:0/2825891714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14032810 con 0x7f4e200ba490 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.019+0000 7f4e270f2640 1 -- 172.21.15.33:0/2825891714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200ba490 msgr2=0x7f4e200be070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.019+0000 7f4e270f2640 1 --2- 172.21.15.33:0/2825891714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200ba490 0x7f4e200be070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006f1c0 tx=0x7f4e1402a270 comp rx=0 tx=0).stop 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.020+0000 7f4e270f2640 1 -- 172.21.15.33:0/2825891714 shutdown_connections 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.020+0000 7f4e270f2640 1 --2- 172.21.15.33:0/2825891714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200ba490 0x7f4e200be070 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.020+0000 7f4e270f2640 1 --2- 172.21.15.33:0/2825891714 >> v2:172.21.15.155:3300/0 conn(0x7f4e200b9570 0x7f4e2006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.020+0000 7f4e270f2640 1 -- 172.21.15.33:0/2825891714 >> 172.21.15.33:0/2825891714 conn(0x7f4e200bebf0 msgr2=0x7f4e200bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.020+0000 7f4e270f2640 1 -- 172.21.15.33:0/2825891714 shutdown_connections 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.020+0000 7f4e270f2640 1 -- 172.21.15.33:0/2825891714 wait complete. 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.021+0000 7f4e270f2640 1 Processor -- start 2024-04-25T15:20:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.021+0000 7f4e270f2640 1 -- start start 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.022+0000 7f4e270f2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e2014cd40 0x7f4e20149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.022+0000 7f4e270f2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20146a90 0x7f4e201e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.022+0000 7f4e270f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e200b5ef0 0x7f4e200b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.022+0000 7f4e270f2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2014d2d0 con 0x7f4e2014cd40 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.022+0000 7f4e270f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2014d150 con 0x7f4e200b5ef0 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.022+0000 7f4e270f2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e201540b0 con 0x7f4e20146a90 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e2014cd40 0x7f4e20149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e2014cd40 0x7f4e20149760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51546/0 (socket says 172.21.15.33:51546) 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 -- 172.21.15.33:0/3655470810 learned_addr learned my addr 172.21.15.33:0/3655470810 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e1ffff640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20146a90 0x7f4e201e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e2568f640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e200b5ef0 0x7f4e200b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 -- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20146a90 msgr2=0x7f4e201e2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20146a90 0x7f4e201e2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 -- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e200b5ef0 msgr2=0x7f4e200b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e200b5ef0 0x7f4e200b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 -- 172.21.15.33:0/3655470810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e20147640 con 0x7f4e2014cd40 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e2568f640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e200b5ef0 0x7f4e200b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e24e8e640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e2014cd40 0x7f4e20149760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000e870 tx=0x7f4e1000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e1d7fa640 1 -- 172.21.15.33:0/3655470810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e10017070 con 0x7f4e2014cd40 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e1d7fa640 1 -- 172.21.15.33:0/3655470810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1000c940 con 0x7f4e2014cd40 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e201e3280 con 0x7f4e2014cd40 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e1d7fa640 1 -- 172.21.15.33:0/3655470810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000cd10 con 0x7f4e2014cd40 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.023+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e201e2540 con 0x7f4e2014cd40 2024-04-25T15:20:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.024+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e20147810 con 0x7f4e2014cd40 2024-04-25T15:20:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.025+0000 7f4e1d7fa640 1 -- 172.21.15.33:0/3655470810 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4e1001a070 con 0x7f4e2014cd40 2024-04-25T15:20:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.026+0000 7f4e1d7fa640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4e0c0744e0 0x7f4e0c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.026+0000 7f4e1d7fa640 1 -- 172.21.15.33:0/3655470810 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e10095080 con 0x7f4e2014cd40 2024-04-25T15:20:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.026+0000 7f4e1ffff640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4e0c0744e0 0x7f4e0c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.026+0000 7f4e1ffff640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4e0c0744e0 0x7f4e0c0769f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4e14034000 tx=0x7f4e1402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.030+0000 7f4e1d7fa640 1 -- 172.21.15.33:0/3655470810 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e1005f1c0 con 0x7f4e2014cd40 2024-04-25T15:20:53.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.214+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4e200764e0 con 0x7f4e2014cd40 2024-04-25T15:20:53.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.214+0000 7f4e1d7fa640 1 -- 172.21.15.33:0/3655470810 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4e100634c0 con 0x7f4e2014cd40 2024-04-25T15:20:53.216 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-04-25T15:20:53.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4e0c0744e0 msgr2=0x7f4e0c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4e0c0744e0 0x7f4e0c0769f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4e14034000 tx=0x7f4e1402e000 comp rx=0 tx=0).stop 2024-04-25T15:20:53.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e2014cd40 msgr2=0x7f4e20149760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e2014cd40 0x7f4e20149760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000e870 tx=0x7f4e1000ed30 comp rx=0 tx=0).stop 2024-04-25T15:20:53.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 shutdown_connections 2024-04-25T15:20:53.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4e0c0744e0 0x7f4e0c0769f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e200b5ef0 0x7f4e200b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e20146a90 0x7f4e201e2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 --2- 172.21.15.33:0/3655470810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e2014cd40 0x7f4e20149760 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 >> 172.21.15.33:0/3655470810 conn(0x7f4e200bebf0 msgr2=0x7f4e200bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:53.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 shutdown_connections 2024-04-25T15:20:53.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.216+0000 7f4e270f2640 1 -- 172.21.15.33:0/3655470810 wait complete. 2024-04-25T15:20:53.229 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:20:53.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.338+0000 7f3a1e79d640 1 Processor -- start 2024-04-25T15:20:53.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.339+0000 7f3a1e79d640 1 -- start start 2024-04-25T15:20:53.342 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1e79d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a18143860 0x7f3a180ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1e79d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a180be030 con 0x7f3a1806ce80 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1e79d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a180be310 con 0x7f3a1806d290 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1e79d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a180be680 con 0x7f3a18143860 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1cf9a640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3a1806ce80 0x7f3a1814cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45344/0 (socket says 172.21.15.33:45344) 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1cf9a640 1 -- 172.21.15.33:0/2071011388 learned_addr learned my addr 172.21.15.33:0/2071011388 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1d79b640 1 --2- 172.21.15.33:0/2071011388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a18143860 0x7f3a180ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a0ffff640 1 -- 172.21.15.33:0/2071011388 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115283195 0 0) 0x7f3a180be030 con 0x7f3a1806ce80 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a0ffff640 1 -- 172.21.15.33:0/2071011388 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a04003520 con 0x7f3a1806ce80 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a0ffff640 1 -- 172.21.15.33:0/2071011388 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631662260 0 0) 0x7f3a180be310 con 0x7f3a1806d290 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a0ffff640 1 -- 172.21.15.33:0/2071011388 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a180be030 con 0x7f3a1806d290 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1d79b640 1 -- 172.21.15.33:0/2071011388 >> v1:172.21.15.155:6789/0 conn(0x7f3a1806d290 legacy=0x7f3a18153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1d79b640 1 -- 172.21.15.33:0/2071011388 >> v1:172.21.15.33:6789/0 conn(0x7f3a1806ce80 legacy=0x7f3a1814cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a0ffff640 1 -- 172.21.15.33:0/2071011388 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 827650556 0 0) 0x7f3a04003520 con 0x7f3a1806ce80 2024-04-25T15:20:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.340+0000 7f3a1d79b640 1 -- 172.21.15.33:0/2071011388 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a180ba5b0 con 0x7f3a18143860 2024-04-25T15:20:53.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.341+0000 7f3a1d79b640 1 --2- 172.21.15.33:0/2071011388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a18143860 0x7f3a180ba070 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a180be800 tx=0x7f3a1402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2abe2bb0ab54a1a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.341+0000 7f3a0ffff640 1 -- 172.21.15.33:0/2071011388 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14037070 con 0x7f3a18143860 2024-04-25T15:20:53.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.341+0000 7f3a0ffff640 1 -- 172.21.15.33:0/2071011388 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1402ab90 con 0x7f3a18143860 2024-04-25T15:20:53.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.341+0000 7f3a0ffff640 1 -- 172.21.15.33:0/2071011388 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a08001670 con 0x7f3a18143860 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.342+0000 7f3a1e79d640 1 -- 172.21.15.33:0/2071011388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a18143860 msgr2=0x7f3a180ba070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.342+0000 7f3a1e79d640 1 --2- 172.21.15.33:0/2071011388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a18143860 0x7f3a180ba070 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a180be800 tx=0x7f3a1402a100 comp rx=0 tx=0).stop 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.342+0000 7f3a1e79d640 1 -- 172.21.15.33:0/2071011388 shutdown_connections 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.342+0000 7f3a1e79d640 1 --2- 172.21.15.33:0/2071011388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a18143860 0x7f3a180ba070 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.342+0000 7f3a1e79d640 1 -- 172.21.15.33:0/2071011388 >> 172.21.15.33:0/2071011388 conn(0x7f3a180bea50 msgr2=0x7f3a180bee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.342+0000 7f3a1e79d640 1 -- 172.21.15.33:0/2071011388 shutdown_connections 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.342+0000 7f3a1e79d640 1 -- 172.21.15.33:0/2071011388 wait complete. 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.344+0000 7f3a1e79d640 1 Processor -- start 2024-04-25T15:20:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.344+0000 7f3a1e79d640 1 -- start start 2024-04-25T15:20:53.347 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1e79d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a1806ce80 0x7f3a181e0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1e79d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a1806d290 0x7f3a180a3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1e79d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a18143860 0x7f3a180a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1e79d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3a180bdd20 con 0x7f3a18143860 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1e79d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a180bdba0 con 0x7f3a1806d290 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1e79d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1814d4d0 con 0x7f3a1806ce80 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a18143860 0x7f3a180a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a18143860 0x7f3a180a2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51558/0 (socket says 172.21.15.33:51558) 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 -- 172.21.15.33:0/1214812254 learned_addr learned my addr 172.21.15.33:0/1214812254 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1cf9a640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a1806d290 0x7f3a180a3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1d79b640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a1806ce80 0x7f3a181e0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 -- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a1806ce80 msgr2=0x7f3a181e0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a1806ce80 0x7f3a181e0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 -- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a1806d290 msgr2=0x7f3a180a3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a1806d290 0x7f3a180a3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 -- 172.21.15.33:0/1214812254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a181df580 con 0x7f3a18143860 2024-04-25T15:20:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1df9c640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a18143860 0x7f3a180a2080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c710 tx=0x7f3a1000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a0dffb640 1 -- 172.21.15.33:0/1214812254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10003b70 con 0x7f3a18143860 2024-04-25T15:20:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a0dffb640 1 -- 172.21.15.33:0/1214812254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a10003d10 con 0x7f3a18143860 2024-04-25T15:20:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.345+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a181df840 con 0x7f3a18143860 2024-04-25T15:20:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.346+0000 7f3a0dffb640 1 -- 172.21.15.33:0/1214812254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000aa50 con 0x7f3a18143860 2024-04-25T15:20:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.346+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a18147050 con 0x7f3a18143860 2024-04-25T15:20:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.347+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a18076c00 con 0x7f3a18143860 2024-04-25T15:20:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.347+0000 7f3a0dffb640 1 -- 172.21.15.33:0/1214812254 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3a1000abf0 con 0x7f3a18143860 2024-04-25T15:20:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.348+0000 7f3a0dffb640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f39fc0744b0 0x7f39fc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.348+0000 7f3a0dffb640 1 -- 172.21.15.33:0/1214812254 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3a10095020 con 0x7f3a18143860 2024-04-25T15:20:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.348+0000 7f3a1d79b640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f39fc0744b0 0x7f39fc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.349+0000 7f3a1d79b640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f39fc0744b0 0x7f39fc0769c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a14034000 tx=0x7f3a1402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.352+0000 7f3a0dffb640 1 -- 172.21.15.33:0/1214812254 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3a1000ce20 con 0x7f3a18143860 2024-04-25T15:20:53.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.579+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a180b93d0 con 0x7f3a18143860 2024-04-25T15:20:53.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.579+0000 7f3a0dffb640 1 -- 172.21.15.33:0/1214812254 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3524 (secure 0 0 0) 0x7f3a1005f8d0 con 0x7f3a18143860 2024-04-25T15:20:53.581 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:53.581 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2065139550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2065139550},{"type":"v1","addr":"172.21.15.155:6835","nonce":2065139550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:20:41.780676+0000","modified":"2024-04-25T15:20:44.800148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/23089112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":23089112},{"type":"v1","addr":"172.21.15.33:6833","nonce":23089112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-04-25T15:20:53.581 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-04-25T15:20:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f39fc0744b0 msgr2=0x7f39fc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f39fc0744b0 0x7f39fc0769c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a14034000 tx=0x7f3a1402e000 comp rx=0 tx=0).stop 2024-04-25T15:20:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a18143860 msgr2=0x7f3a180a2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a18143860 0x7f3a180a2080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c710 tx=0x7f3a1000cbd0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 shutdown_connections 2024-04-25T15:20:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f39fc0744b0 0x7f39fc0769c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a18143860 0x7f3a180a2080 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a1806d290 0x7f3a180a3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 --2- 172.21.15.33:0/1214812254 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a1806ce80 0x7f3a181e0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.581+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 >> 172.21.15.33:0/1214812254 conn(0x7f3a180bea50 msgr2=0x7f3a180b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.582+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 shutdown_connections 2024-04-25T15:20:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.582+0000 7f3a1e79d640 1 -- 172.21.15.33:0/1214812254 wait complete. 2024-04-25T15:20:53.595 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.705+0000 7fa579d57640 1 Processor -- start 2024-04-25T15:20:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.705+0000 7fa579d57640 1 -- start start 2024-04-25T15:20:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.706+0000 7fa579d57640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5740b5f10 0x7fa574073200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.706+0000 7fa579d57640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa574143390 0x7fa574145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.706+0000 7fa579d57640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5740b7280 con 0x7fa574145be0 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.706+0000 7fa579d57640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fa5740b6df0 con 0x7fa574143390 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.706+0000 7fa579d57640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa5740b6320 con 0x7fa5740b5f10 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.706+0000 7fa573fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa574143390 0x7fa574145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.706+0000 7fa573fff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa574143390 0x7fa574145ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51568/0 (socket says 172.21.15.33:51568) 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.707+0000 7fa573fff640 1 -- 172.21.15.33:0/1625490057 learned_addr learned my addr 172.21.15.33:0/1625490057 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.707+0000 7fa5737fe640 1 --2- 172.21.15.33:0/1625490057 >> v2:172.21.15.155:3300/0 conn(0x7fa5740b5f10 0x7fa574073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.707+0000 7fa573fff640 1 -- 172.21.15.33:0/1625490057 >> v2:172.21.15.155:3300/0 conn(0x7fa5740b5f10 msgr2=0x7fa574073200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.707+0000 7fa573fff640 1 --2- 172.21.15.33:0/1625490057 >> v2:172.21.15.155:3300/0 conn(0x7fa5740b5f10 0x7fa574073200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.707+0000 7fa573fff640 1 -- 172.21.15.33:0/1625490057 >> v1:172.21.15.155:6789/0 conn(0x7fa574145be0 legacy=0x7fa574142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.707+0000 7fa573fff640 1 -- 172.21.15.33:0/1625490057 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa574072db0 con 0x7fa574143390 2024-04-25T15:20:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.707+0000 7fa5737fe640 1 --2- 172.21.15.33:0/1625490057 >> v2:172.21.15.155:3300/0 conn(0x7fa5740b5f10 0x7fa574073200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:53.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.707+0000 7fa573fff640 1 --2- 172.21.15.33:0/1625490057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa574145ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b6f70 tx=0x7fa56c02b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559f9b52ec9fbd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa5727fc640 1 -- 172.21.15.33:0/1625490057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c037070 con 0x7fa574143390 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa5727fc640 1 -- 172.21.15.33:0/1625490057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa56c032600 con 0x7fa574143390 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa5727fc640 1 -- 172.21.15.33:0/1625490057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0329d0 con 0x7fa574143390 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa579d57640 1 -- 172.21.15.33:0/1625490057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 msgr2=0x7fa574145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa579d57640 1 --2- 172.21.15.33:0/1625490057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa574145ff0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b6f70 tx=0x7fa56c02b720 comp rx=0 tx=0).stop 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa579d57640 1 -- 172.21.15.33:0/1625490057 shutdown_connections 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa579d57640 1 --2- 172.21.15.33:0/1625490057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa574145ff0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa579d57640 1 --2- 172.21.15.33:0/1625490057 >> v2:172.21.15.155:3300/0 conn(0x7fa5740b5f10 0x7fa574073200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa579d57640 1 -- 172.21.15.33:0/1625490057 >> 172.21.15.33:0/1625490057 conn(0x7fa57406ce70 msgr2=0x7fa5740ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa579d57640 1 -- 172.21.15.33:0/1625490057 shutdown_connections 2024-04-25T15:20:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.708+0000 7fa579d57640 1 -- 172.21.15.33:0/1625490057 wait complete. 2024-04-25T15:20:53.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.710+0000 7fa579d57640 1 Processor -- start 2024-04-25T15:20:53.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.710+0000 7fa579d57640 1 -- start start 2024-04-25T15:20:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa579d57640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5740b5f10 0x7fa5741de370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa579d57640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa5741d2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa579d57640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa574145be0 0x7fa5741d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa579d57640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa5740b6a80 con 0x7fa574143390 2024-04-25T15:20:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa579d57640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5740b22d0 con 0x7fa574145be0 2024-04-25T15:20:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa579d57640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa574073740 con 0x7fa5740b5f10 2024-04-25T15:20:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa572ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa5741d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa572ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa5741d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51580/0 (socket says 172.21.15.33:51580) 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa572ffd640 1 -- 172.21.15.33:0/4102183594 learned_addr learned my addr 172.21.15.33:0/4102183594 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa573fff640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa574145be0 0x7fa5741d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa5737fe640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5740b5f10 0x7fa5741de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.711+0000 7fa572ffd640 1 -- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5740b5f10 msgr2=0x7fa5741de370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa572ffd640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5740b5f10 0x7fa5741de370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa572ffd640 1 -- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa574145be0 msgr2=0x7fa5741d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa572ffd640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa574145be0 0x7fa5741d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa572ffd640 1 -- 172.21.15.33:0/4102183594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5741d1250 con 0x7fa574143390 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa573fff640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa574145be0 0x7fa5741d2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa572ffd640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa5741d2820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa56800c470 tx=0x7fa56800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa55bfff640 1 -- 172.21.15.33:0/4102183594 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5680052d0 con 0x7fa574143390 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa55bfff640 1 -- 172.21.15.33:0/4102183594 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa568005490 con 0x7fa574143390 2024-04-25T15:20:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5740aace0 con 0x7fa574143390 2024-04-25T15:20:53.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa55bfff640 1 -- 172.21.15.33:0/4102183594 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568007260 con 0x7fa574143390 2024-04-25T15:20:53.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.712+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5741ddb70 con 0x7fa574143390 2024-04-25T15:20:53.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.713+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5741d06c0 con 0x7fa574143390 2024-04-25T15:20:53.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.713+0000 7fa55bfff640 1 -- 172.21.15.33:0/4102183594 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa568007400 con 0x7fa574143390 2024-04-25T15:20:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.714+0000 7fa55bfff640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa5600744e0 0x7fa5600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.714+0000 7fa55bfff640 1 -- 172.21.15.33:0/4102183594 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa568094620 con 0x7fa574143390 2024-04-25T15:20:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.714+0000 7fa5737fe640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa5600744e0 0x7fa5600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.715+0000 7fa5737fe640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa5600744e0 0x7fa5600769f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa564006fd0 tx=0x7fa564008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.719+0000 7fa55bfff640 1 -- 172.21.15.33:0/4102183594 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa56805ee40 con 0x7fa574143390 2024-04-25T15:20:53.908 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.907+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5740764e0 con 0x7fa574143390 2024-04-25T15:20:53.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.908+0000 7fa55bfff640 1 -- 172.21.15.33:0/4102183594 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7fa56805e740 con 0x7fa574143390 2024-04-25T15:20:53.910 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:53.910 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:43.397488+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa5600744e0 msgr2=0x7fa5600769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa5600744e0 0x7fa5600769f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa564006fd0 tx=0x7fa564008040 comp rx=0 tx=0).stop 2024-04-25T15:20:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 msgr2=0x7fa5741d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa5741d2820 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa56800c470 tx=0x7fa56800c930 comp rx=0 tx=0).stop 2024-04-25T15:20:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 shutdown_connections 2024-04-25T15:20:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa5600744e0 0x7fa5600769f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa574145be0 0x7fa5741d2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa574143390 0x7fa5741d2820 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 --2- 172.21.15.33:0/4102183594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5740b5f10 0x7fa5741de370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 >> 172.21.15.33:0/4102183594 conn(0x7fa57406ce70 msgr2=0x7fa574140f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 shutdown_connections 2024-04-25T15:20:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:53.910+0000 7fa579d57640 1 -- 172.21.15.33:0/4102183594 wait complete. 2024-04-25T15:20:53.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:20:29.721824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:20:39.967842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:20:40.725695+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:20:53.924 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:20:54.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.036+0000 7fbea8449640 1 Processor -- start 2024-04-25T15:20:54.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.036+0000 7fbea8449640 1 -- start start 2024-04-25T15:20:54.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.037+0000 7fbea8449640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbea006d230 0x7fbea00bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.037+0000 7fbea8449640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea0149d40 con 0x7fbea00bcf30 2024-04-25T15:20:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.037+0000 7fbea8449640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea014a020 con 0x7fbea0149840 2024-04-25T15:20:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.037+0000 7fbea8449640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fbea014a820 con 0x7fbea006d230 2024-04-25T15:20:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.037+0000 7fbea59e4640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbea006d230 0x7fbea00bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.037+0000 7fbea59e4640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbea006d230 0x7fbea00bc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51594/0 (socket says 172.21.15.33:51594) 2024-04-25T15:20:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.037+0000 7fbea59e4640 1 -- 172.21.15.33:0/4088948753 learned_addr learned my addr 172.21.15.33:0/4088948753 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.037+0000 7fbea69e6640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbea00bcf30 0x7fbea009d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45358/0 (socket says 172.21.15.33:45358) 2024-04-25T15:20:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.038+0000 7fbea59e4640 1 -- 172.21.15.33:0/4088948753 >> v1:172.21.15.155:6789/0 conn(0x7fbea0149840 legacy=0x7fbea00be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.038+0000 7fbea51e3640 1 -- 172.21.15.33:0/4088948753 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715899806 0 0) 0x7fbea014a020 con 0x7fbea0149840 2024-04-25T15:20:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.038+0000 7fbea59e4640 1 -- 172.21.15.33:0/4088948753 >> v1:172.21.15.33:6789/0 conn(0x7fbea00bcf30 legacy=0x7fbea009d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.038+0000 7fbea59e4640 1 -- 172.21.15.33:0/4088948753 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea014a300 con 0x7fbea006d230 2024-04-25T15:20:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.038+0000 7fbea59e4640 1 --2- 172.21.15.33:0/4088948753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea006d230 0x7fbea00bc9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009870 tx=0x7fbe9402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e107911beb8acb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea51e3640 1 -- 172.21.15.33:0/4088948753 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94037070 con 0x7fbea006d230 2024-04-25T15:20:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea51e3640 1 -- 172.21.15.33:0/4088948753 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe94032440 con 0x7fbea006d230 2024-04-25T15:20:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea51e3640 1 -- 172.21.15.33:0/4088948753 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94032810 con 0x7fbea006d230 2024-04-25T15:20:54.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea8449640 1 -- 172.21.15.33:0/4088948753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea006d230 msgr2=0x7fbea00bc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea8449640 1 --2- 172.21.15.33:0/4088948753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea006d230 0x7fbea00bc9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009870 tx=0x7fbe9402a200 comp rx=0 tx=0).stop 2024-04-25T15:20:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea8449640 1 -- 172.21.15.33:0/4088948753 shutdown_connections 2024-04-25T15:20:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea8449640 1 --2- 172.21.15.33:0/4088948753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea006d230 0x7fbea00bc9f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea8449640 1 -- 172.21.15.33:0/4088948753 >> 172.21.15.33:0/4088948753 conn(0x7fbea00bebf0 msgr2=0x7fbea00bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea8449640 1 -- 172.21.15.33:0/4088948753 shutdown_connections 2024-04-25T15:20:54.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.039+0000 7fbea8449640 1 -- 172.21.15.33:0/4088948753 wait complete. 2024-04-25T15:20:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.041+0000 7fbea8449640 1 Processor -- start 2024-04-25T15:20:54.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.041+0000 7fbea8449640 1 -- start start 2024-04-25T15:20:54.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea8449640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea006d230 0x7fbea00a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea8449640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea00bcf30 0x7fbea00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea8449640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea0149840 0x7fbea00b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea8449640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fbea009dc70 con 0x7fbea00bcf30 2024-04-25T15:20:54.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea8449640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbea009daf0 con 0x7fbea0149840 2024-04-25T15:20:54.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea8449640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbea00b7220 con 0x7fbea006d230 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea00bcf30 0x7fbea00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea00bcf30 0x7fbea00b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51606/0 (socket says 172.21.15.33:51606) 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 -- 172.21.15.33:0/1417998666 learned_addr learned my addr 172.21.15.33:0/1417998666 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea69e6640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea0149840 0x7fbea00b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea61e5640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea006d230 0x7fbea00a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 -- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea006d230 msgr2=0x7fbea00a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea006d230 0x7fbea00a40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 -- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea0149840 msgr2=0x7fbea00b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea0149840 0x7fbea00b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 -- 172.21.15.33:0/1417998666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea00b6d50 con 0x7fbea00bcf30 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea69e6640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea0149840 0x7fbea00b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea61e5640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea006d230 0x7fbea00a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:54.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.042+0000 7fbea59e4640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea00bcf30 0x7fbea00b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009870 tx=0x7fbe940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.043+0000 7fbe9effd640 1 -- 172.21.15.33:0/1417998666 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94041070 con 0x7fbea00bcf30 2024-04-25T15:20:54.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.043+0000 7fbe9effd640 1 -- 172.21.15.33:0/1417998666 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9403c890 con 0x7fbea00bcf30 2024-04-25T15:20:54.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.043+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea00b27a0 con 0x7fbea00bcf30 2024-04-25T15:20:54.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.043+0000 7fbe9effd640 1 -- 172.21.15.33:0/1417998666 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94037040 con 0x7fbea00bcf30 2024-04-25T15:20:54.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.043+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea00a38c0 con 0x7fbea00bcf30 2024-04-25T15:20:54.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.044+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea00a49c0 con 0x7fbea00bcf30 2024-04-25T15:20:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.045+0000 7fbe9effd640 1 -- 172.21.15.33:0/1417998666 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbe94044070 con 0x7fbea00bcf30 2024-04-25T15:20:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.045+0000 7fbe9effd640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fbe8c0744b0 0x7fbe8c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.045+0000 7fbe9effd640 1 -- 172.21.15.33:0/1417998666 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe940b5cf0 con 0x7fbea00bcf30 2024-04-25T15:20:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.045+0000 7fbea61e5640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fbe8c0744b0 0x7fbe8c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.046+0000 7fbea61e5640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fbe8c0744b0 0x7fbe8c0769c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe900012e0 tx=0x7fbe90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.050+0000 7fbe9effd640 1 -- 172.21.15.33:0/1417998666 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbea00a49c0 con 0x7fbea00bcf30 2024-04-25T15:20:54.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.233+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbea0142390 con 0x7fbea00bcf30 2024-04-25T15:20:54.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.233+0000 7fbe9effd640 1 -- 172.21.15.33:0/1417998666 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fbea0142390 con 0x7fbea00bcf30 2024-04-25T15:20:54.235 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fbe8c0744b0 msgr2=0x7fbe8c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fbe8c0744b0 0x7fbe8c0769c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe900012e0 tx=0x7fbe90009040 comp rx=0 tx=0).stop 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea00bcf30 msgr2=0x7fbea00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea00bcf30 0x7fbea00b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009870 tx=0x7fbe940046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 shutdown_connections 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fbe8c0744b0 0x7fbe8c0769c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbea0149840 0x7fbea00b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbea00bcf30 0x7fbea00b4d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 --2- 172.21.15.33:0/1417998666 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbea006d230 0x7fbea00a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 >> 172.21.15.33:0/1417998666 conn(0x7fbea00bebf0 msgr2=0x7fbea00b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 shutdown_connections 2024-04-25T15:20:54.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.235+0000 7fbea8449640 1 -- 172.21.15.33:0/1417998666 wait complete. 2024-04-25T15:20:54.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:20:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.360+0000 7ff5fb2b1640 1 Processor -- start 2024-04-25T15:20:54.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.360+0000 7ff5fb2b1640 1 -- start start 2024-04-25T15:20:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5fb2b1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff5f406d230 0x7ff5f409d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5fb2b1640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff5f40ba4f0 0x7ff5f4149a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5fb2b1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f40b9650 con 0x7ff5f409dae0 2024-04-25T15:20:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5fb2b1640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f40be0c0 con 0x7ff5f40ba4f0 2024-04-25T15:20:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5fb2b1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f40b98c0 con 0x7ff5f406d230 2024-04-25T15:20:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5f984e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff5f40ba4f0 0x7ff5f4149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5f984e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff5f40ba4f0 0x7ff5f4149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51616/0 (socket says 172.21.15.33:51616) 2024-04-25T15:20:54.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5f984e640 1 -- 172.21.15.33:0/2750411091 learned_addr learned my addr 172.21.15.33:0/2750411091 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:54.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.361+0000 7ff5f904d640 1 --2- 172.21.15.33:0/2750411091 >> v2:172.21.15.155:3300/0 conn(0x7ff5f406d230 0x7ff5f409d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.362+0000 7ff5f984e640 1 -- 172.21.15.33:0/2750411091 >> v2:172.21.15.155:3300/0 conn(0x7ff5f406d230 msgr2=0x7ff5f409d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:54.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.362+0000 7ff5f984e640 1 --2- 172.21.15.33:0/2750411091 >> v2:172.21.15.155:3300/0 conn(0x7ff5f406d230 0x7ff5f409d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.362+0000 7ff5f984e640 1 -- 172.21.15.33:0/2750411091 >> v1:172.21.15.155:6789/0 conn(0x7ff5f409dae0 legacy=0x7ff5f40b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.362+0000 7ff5f984e640 1 -- 172.21.15.33:0/2750411091 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f406d640 con 0x7ff5f40ba4f0 2024-04-25T15:20:54.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.362+0000 7ff5f984e640 1 --2- 172.21.15.33:0/2750411091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f40ba4f0 0x7ff5f4149a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5f406f780 tx=0x7ff5ec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c2441120feaf88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.362+0000 7ff5ebfff640 1 -- 172.21.15.33:0/2750411091 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec036070 con 0x7ff5f40ba4f0 2024-04-25T15:20:54.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.362+0000 7ff5ebfff640 1 -- 172.21.15.33:0/2750411091 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec031600 con 0x7ff5f40ba4f0 2024-04-25T15:20:54.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.362+0000 7ff5ebfff640 1 -- 172.21.15.33:0/2750411091 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0319d0 con 0x7ff5f40ba4f0 2024-04-25T15:20:54.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.363+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/2750411091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f40ba4f0 msgr2=0x7ff5f4149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.363+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/2750411091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f40ba4f0 0x7ff5f4149a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5f406f780 tx=0x7ff5ec02a6a0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.363+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/2750411091 shutdown_connections 2024-04-25T15:20:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.363+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/2750411091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f40ba4f0 0x7ff5f4149a70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.363+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/2750411091 >> v2:172.21.15.155:3300/0 conn(0x7ff5f406d230 0x7ff5f409d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.363+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/2750411091 >> 172.21.15.33:0/2750411091 conn(0x7ff5f40bebf0 msgr2=0x7ff5f40bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.363+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/2750411091 shutdown_connections 2024-04-25T15:20:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.363+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/2750411091 wait complete. 2024-04-25T15:20:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.365+0000 7ff5fb2b1640 1 Processor -- start 2024-04-25T15:20:54.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.365+0000 7ff5fb2b1640 1 -- start start 2024-04-25T15:20:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5fb2b1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f406d230 0x7ff5f40b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5fb2b1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f409dae0 0x7ff5f4144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5fb2b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f40ba4f0 0x7ff5f41e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5fb2b1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f414a130 con 0x7ff5f409dae0 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5fb2b1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f4149fb0 con 0x7ff5f40ba4f0 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5fb2b1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f414a2b0 con 0x7ff5f406d230 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f409dae0 0x7ff5f4144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f409dae0 0x7ff5f4144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51620/0 (socket says 172.21.15.33:51620) 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 -- 172.21.15.33:0/536372749 learned_addr learned my addr 172.21.15.33:0/536372749 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f904d640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f406d230 0x7ff5f40b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f984e640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f40ba4f0 0x7ff5f41e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 -- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f406d230 msgr2=0x7ff5f40b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f406d230 0x7ff5f40b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 -- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f40ba4f0 msgr2=0x7ff5f41e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f40ba4f0 0x7ff5f41e3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 -- 172.21.15.33:0/536372749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f4144570 con 0x7ff5f409dae0 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5f884c640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f409dae0 0x7ff5f4144a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400c3f0 tx=0x7ff5e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5e9ffb640 1 -- 172.21.15.33:0/536372749 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4017070 con 0x7ff5f409dae0 2024-04-25T15:20:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.366+0000 7ff5e9ffb640 1 -- 172.21.15.33:0/536372749 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e40052f0 con 0x7ff5f409dae0 2024-04-25T15:20:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.367+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f4144f40 con 0x7ff5f409dae0 2024-04-25T15:20:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.367+0000 7ff5e9ffb640 1 -- 172.21.15.33:0/536372749 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4003830 con 0x7ff5f409dae0 2024-04-25T15:20:54.370 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.367+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f40b57e0 con 0x7ff5f409dae0 2024-04-25T15:20:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.368+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f40764e0 con 0x7ff5f409dae0 2024-04-25T15:20:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.368+0000 7ff5e9ffb640 1 -- 172.21.15.33:0/536372749 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff5e401a070 con 0x7ff5f409dae0 2024-04-25T15:20:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.369+0000 7ff5e9ffb640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff5d80744b0 0x7ff5d80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.369+0000 7ff5e9ffb640 1 -- 172.21.15.33:0/536372749 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e4094520 con 0x7ff5f409dae0 2024-04-25T15:20:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.369+0000 7ff5f904d640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff5d80744b0 0x7ff5d80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.370+0000 7ff5f904d640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff5d80744b0 0x7ff5d80769c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009aa0 tx=0x7ff5f0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.374+0000 7ff5e9ffb640 1 -- 172.21.15.33:0/536372749 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5e405e660 con 0x7ff5f409dae0 2024-04-25T15:20:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.558+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff5f4076200 con 0x7ff5f409dae0 2024-04-25T15:20:54.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.559+0000 7ff5e9ffb640 1 -- 172.21.15.33:0/536372749 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7ff5e4062960 con 0x7ff5f409dae0 2024-04-25T15:20:54.560 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-04-25T15:20:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff5d80744b0 msgr2=0x7ff5d80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff5d80744b0 0x7ff5d80769c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0009aa0 tx=0x7ff5f0009190 comp rx=0 tx=0).stop 2024-04-25T15:20:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f409dae0 msgr2=0x7ff5f4144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f409dae0 0x7ff5f4144a00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400c3f0 tx=0x7ff5e400c8b0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 shutdown_connections 2024-04-25T15:20:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff5d80744b0 0x7ff5d80769c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f40ba4f0 0x7ff5f41e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f409dae0 0x7ff5f4144a00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 --2- 172.21.15.33:0/536372749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f406d230 0x7ff5f40b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 >> 172.21.15.33:0/536372749 conn(0x7ff5f40bebf0 msgr2=0x7ff5f4147820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 shutdown_connections 2024-04-25T15:20:54.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.561+0000 7ff5fb2b1640 1 -- 172.21.15.33:0/536372749 wait complete. 2024-04-25T15:20:54.573 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:20:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.685+0000 7ff3f4b34640 1 Processor -- start 2024-04-25T15:20:54.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.685+0000 7ff3f4b34640 1 -- start start 2024-04-25T15:20:54.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.686+0000 7ff3f4b34640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3f00ba490 0x7ff3f006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.686+0000 7ff3f4b34640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3f014cd40 0x7ff3f009d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.686+0000 7ff3f4b34640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f00b99b0 con 0x7ff3f00b9570 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.686+0000 7ff3f4b34640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f00b9c90 con 0x7ff3f014cd40 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.686+0000 7ff3f4b34640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f00b9f70 con 0x7ff3f00ba490 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.687+0000 7ff3eed9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3f014cd40 0x7ff3f009d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.687+0000 7ff3eed9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff3f014cd40 0x7ff3f009d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49084/0 (socket says 172.21.15.33:49084) 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.687+0000 7ff3eed9d640 1 -- 172.21.15.33:0/1519653489 learned_addr learned my addr 172.21.15.33:0/1519653489 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.687+0000 7ff3edd9b640 1 --2- 172.21.15.33:0/1519653489 >> v2:172.21.15.155:3300/0 conn(0x7ff3f00ba490 0x7ff3f006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.687+0000 7ff3eed9d640 1 -- 172.21.15.33:0/1519653489 >> v2:172.21.15.155:3300/0 conn(0x7ff3f00ba490 msgr2=0x7ff3f006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.687+0000 7ff3eed9d640 1 --2- 172.21.15.33:0/1519653489 >> v2:172.21.15.155:3300/0 conn(0x7ff3f00ba490 0x7ff3f006d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.687+0000 7ff3eed9d640 1 -- 172.21.15.33:0/1519653489 >> v1:172.21.15.155:6789/0 conn(0x7ff3f00b9570 legacy=0x7ff3f00be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:54.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.687+0000 7ff3eed9d640 1 -- 172.21.15.33:0/1519653489 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f014d150 con 0x7ff3f014cd40 2024-04-25T15:20:54.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.688+0000 7ff3eed9d640 1 --2- 172.21.15.33:0/1519653489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f014cd40 0x7ff3f009d610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff3f006f4a0 tx=0x7ff3e002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208b4db1b106ee7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.688+0000 7ff3ed59a640 1 -- 172.21.15.33:0/1519653489 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0036070 con 0x7ff3f014cd40 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.688+0000 7ff3ed59a640 1 -- 172.21.15.33:0/1519653489 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e0031600 con 0x7ff3f014cd40 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.688+0000 7ff3ed59a640 1 -- 172.21.15.33:0/1519653489 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00319d0 con 0x7ff3f014cd40 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.688+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1519653489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f014cd40 msgr2=0x7ff3f009d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.688+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1519653489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f014cd40 0x7ff3f009d610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff3f006f4a0 tx=0x7ff3e002a6f0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.689+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1519653489 shutdown_connections 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.689+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1519653489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f014cd40 0x7ff3f009d610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.689+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1519653489 >> v2:172.21.15.155:3300/0 conn(0x7ff3f00ba490 0x7ff3f006d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.689+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1519653489 >> 172.21.15.33:0/1519653489 conn(0x7ff3f00bebf0 msgr2=0x7ff3f00bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.689+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1519653489 shutdown_connections 2024-04-25T15:20:54.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.689+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1519653489 wait complete. 2024-04-25T15:20:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.690+0000 7ff3f4b34640 1 Processor -- start 2024-04-25T15:20:54.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.690+0000 7ff3f4b34640 1 -- start start 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3f4b34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f014cd40 0x7ff3f0146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3f4b34640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f00a3a50 0x7ff3f01e2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3f4b34640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f01406a0 0x7ff3f0140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3f4b34640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f01540b0 con 0x7ff3f00a3a50 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3f4b34640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f009dd60 con 0x7ff3f014cd40 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3f4b34640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f0154230 con 0x7ff3f01406a0 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3edd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f00a3a50 0x7ff3f01e2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3edd9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f00a3a50 0x7ff3f01e2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49088/0 (socket says 172.21.15.33:49088) 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3edd9b640 1 -- 172.21.15.33:0/1341314340 learned_addr learned my addr 172.21.15.33:0/1341314340 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:54.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3ee59c640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f014cd40 0x7ff3f0146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.691+0000 7ff3eed9d640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f01406a0 0x7ff3f0140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3edd9b640 1 -- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f01406a0 msgr2=0x7ff3f0140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3edd9b640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f01406a0 0x7ff3f0140ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3edd9b640 1 -- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f014cd40 msgr2=0x7ff3f0146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3edd9b640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f014cd40 0x7ff3f0146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3edd9b640 1 -- 172.21.15.33:0/1341314340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f01e3330 con 0x7ff3f00a3a50 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3ee59c640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f014cd40 0x7ff3f0146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3eed9d640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f01406a0 0x7ff3f0140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3edd9b640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f00a3a50 0x7ff3f01e2df0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800d600 tx=0x7ff3d800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3e6ffd640 1 -- 172.21.15.33:0/1341314340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80125f0 con 0x7ff3f00a3a50 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3e6ffd640 1 -- 172.21.15.33:0/1341314340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d8019070 con 0x7ff3f00a3a50 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f0149090 con 0x7ff3f00a3a50 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3e6ffd640 1 -- 172.21.15.33:0/1341314340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80129f0 con 0x7ff3f00a3a50 2024-04-25T15:20:54.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.692+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f00a42a0 con 0x7ff3f00a3a50 2024-04-25T15:20:54.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.693+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f0074550 con 0x7ff3f00a3a50 2024-04-25T15:20:54.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.694+0000 7ff3e6ffd640 1 -- 172.21.15.33:0/1341314340 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff3d8012b90 con 0x7ff3f00a3a50 2024-04-25T15:20:54.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.694+0000 7ff3e6ffd640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff3d00744b0 0x7ff3d00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.694+0000 7ff3e6ffd640 1 -- 172.21.15.33:0/1341314340 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3d80956b0 con 0x7ff3f00a3a50 2024-04-25T15:20:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.695+0000 7ff3ee59c640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff3d00744b0 0x7ff3d00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.695+0000 7ff3ee59c640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff3d00744b0 0x7ff3d00769c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8006fd0 tx=0x7ff3e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.699+0000 7ff3e6ffd640 1 -- 172.21.15.33:0/1341314340 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3f0074550 con 0x7ff3f00a3a50 2024-04-25T15:20:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.885+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3f00bf3c0 con 0x7ff3f00a3a50 2024-04-25T15:20:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.886+0000 7ff3e6ffd640 1 -- 172.21.15.33:0/1341314340 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7ff3f00bf3c0 con 0x7ff3f00a3a50 2024-04-25T15:20:54.887 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff3d00744b0 msgr2=0x7ff3d00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff3d00744b0 0x7ff3d00769c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8006fd0 tx=0x7ff3e8008040 comp rx=0 tx=0).stop 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f00a3a50 msgr2=0x7ff3f01e2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f00a3a50 0x7ff3f01e2df0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800d600 tx=0x7ff3d800dac0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 shutdown_connections 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff3d00744b0 0x7ff3d00769c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f01406a0 0x7ff3f0140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3f00a3a50 0x7ff3f01e2df0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 --2- 172.21.15.33:0/1341314340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f014cd40 0x7ff3f0146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 >> 172.21.15.33:0/1341314340 conn(0x7ff3f00bebf0 msgr2=0x7ff3f00bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 shutdown_connections 2024-04-25T15:20:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:54.888+0000 7ff3f4b34640 1 -- 172.21.15.33:0/1341314340 wait complete. 2024-04-25T15:20:54.901 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:20:55.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.010+0000 7f346f492640 1 Processor -- start 2024-04-25T15:20:55.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.011+0000 7f346f492640 1 -- start start 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346f492640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34680b6f20 0x7f346806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346f492640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f346814cd60 0x7f346814d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346f492640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34680b7330 con 0x7f3468073150 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346f492640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f34680b5b90 con 0x7f346814cd60 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346f492640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3468143da0 con 0x7f34680b6f20 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346da2f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f346814cd60 0x7f346814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346da2f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f346814cd60 0x7f346814d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49104/0 (socket says 172.21.15.33:49104) 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346da2f640 1 -- 172.21.15.33:0/533250870 learned_addr learned my addr 172.21.15.33:0/533250870 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346ca2d640 1 --2- 172.21.15.33:0/533250870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34680b6f20 0x7f346806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346da2f640 1 -- 172.21.15.33:0/533250870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34680b6f20 msgr2=0x7f346806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346da2f640 1 --2- 172.21.15.33:0/533250870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34680b6f20 0x7f346806fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346da2f640 1 -- 172.21.15.33:0/533250870 >> v1:172.21.15.155:6789/0 conn(0x7f3468073150 legacy=0x7f3468143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:55.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346da2f640 1 -- 172.21.15.33:0/533250870 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3468073770 con 0x7f346814cd60 2024-04-25T15:20:55.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.012+0000 7f346ca2d640 1 --2- 172.21.15.33:0/533250870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34680b6f20 0x7f346806fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.013+0000 7f346da2f640 1 --2- 172.21.15.33:0/533250870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f346814d170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f34680b6720 tx=0x7f346002a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4ae4810c97d2c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.013+0000 7f3467fff640 1 -- 172.21.15.33:0/533250870 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460037070 con 0x7f346814cd60 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.013+0000 7f3467fff640 1 -- 172.21.15.33:0/533250870 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346002ade0 con 0x7f346814cd60 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.013+0000 7f3467fff640 1 -- 172.21.15.33:0/533250870 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460032660 con 0x7f346814cd60 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.014+0000 7f346f492640 1 -- 172.21.15.33:0/533250870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 msgr2=0x7f346814d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.014+0000 7f346f492640 1 --2- 172.21.15.33:0/533250870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f346814d170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f34680b6720 tx=0x7f346002a0d0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.014+0000 7f346f492640 1 -- 172.21.15.33:0/533250870 shutdown_connections 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.014+0000 7f346f492640 1 --2- 172.21.15.33:0/533250870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f346814d170 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.014+0000 7f346f492640 1 --2- 172.21.15.33:0/533250870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34680b6f20 0x7f346806fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.014+0000 7f346f492640 1 -- 172.21.15.33:0/533250870 >> 172.21.15.33:0/533250870 conn(0x7f34680bbeb0 msgr2=0x7f346806f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:55.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.014+0000 7f346f492640 1 -- 172.21.15.33:0/533250870 shutdown_connections 2024-04-25T15:20:55.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.014+0000 7f346f492640 1 -- 172.21.15.33:0/533250870 wait complete. 2024-04-25T15:20:55.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.015+0000 7f346f492640 1 Processor -- start 2024-04-25T15:20:55.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.015+0000 7f346f492640 1 -- start start 2024-04-25T15:20:55.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346f492640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3468073150 0x7f346813e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346f492640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34680b6f20 0x7f3468145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346f492640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f34681e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346f492640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f346814d6b0 con 0x7f346814cd60 2024-04-25T15:20:55.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346f492640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3468073d30 con 0x7f34680b6f20 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346f492640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3468153ff0 con 0x7f3468073150 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346da2f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f34681e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346da2f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f34681e33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49112/0 (socket says 172.21.15.33:49112) 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.016+0000 7f346da2f640 1 -- 172.21.15.33:0/1367268223 learned_addr learned my addr 172.21.15.33:0/1367268223 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346ca2d640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34680b6f20 0x7f3468145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346d22e640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3468073150 0x7f346813e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346da2f640 1 -- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3468073150 msgr2=0x7f346813e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346da2f640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3468073150 0x7f346813e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346da2f640 1 -- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34680b6f20 msgr2=0x7f3468145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346da2f640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34680b6f20 0x7f3468145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346da2f640 1 -- 172.21.15.33:0/1367268223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346813eba0 con 0x7f346814cd60 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346d22e640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3468073150 0x7f346813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346ca2d640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34680b6f20 0x7f3468145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:55.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346da2f640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f34681e33f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f346002a110 tx=0x7f3460004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f3465ffb640 1 -- 172.21.15.33:0/1367268223 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460041070 con 0x7f346814cd60 2024-04-25T15:20:55.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f3465ffb640 1 -- 172.21.15.33:0/1367268223 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346003c670 con 0x7f346814cd60 2024-04-25T15:20:55.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f3465ffb640 1 -- 172.21.15.33:0/1367268223 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460037040 con 0x7f346814cd60 2024-04-25T15:20:55.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3468146030 con 0x7f346814cd60 2024-04-25T15:20:55.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.017+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3468146550 con 0x7f346814cd60 2024-04-25T15:20:55.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.018+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346806f750 con 0x7f346814cd60 2024-04-25T15:20:55.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.019+0000 7f3465ffb640 1 -- 172.21.15.33:0/1367268223 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3460044070 con 0x7f346814cd60 2024-04-25T15:20:55.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.019+0000 7f3465ffb640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f34540744b0 0x7f34540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.019+0000 7f3465ffb640 1 -- 172.21.15.33:0/1367268223 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f34600b5960 con 0x7f346814cd60 2024-04-25T15:20:55.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.020+0000 7f346d22e640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f34540744b0 0x7f34540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.020+0000 7f346d22e640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f34540744b0 0x7f34540769c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3468072c60 tx=0x7f3458009550 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.024+0000 7f3465ffb640 1 -- 172.21.15.33:0/1367268223 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34600801a0 con 0x7f346814cd60 2024-04-25T15:20:55.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.247+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34680764e0 con 0x7f346814cd60 2024-04-25T15:20:55.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.248+0000 7f3465ffb640 1 -- 172.21.15.33:0/1367268223 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3524 (secure 0 0 0) 0x7f346007faa0 con 0x7f346814cd60 2024-04-25T15:20:55.249 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:55.250 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2065139550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2065139550},{"type":"v1","addr":"172.21.15.155:6835","nonce":2065139550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:20:41.780676+0000","modified":"2024-04-25T15:20:44.800148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/23089112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":23089112},{"type":"v1","addr":"172.21.15.33:6833","nonce":23089112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-04-25T15:20:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f34540744b0 msgr2=0x7f34540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f34540744b0 0x7f34540769c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3468072c60 tx=0x7f3458009550 comp rx=0 tx=0).stop 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 msgr2=0x7f34681e33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f34681e33f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f346002a110 tx=0x7f3460004730 comp rx=0 tx=0).stop 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 shutdown_connections 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f34540744b0 0x7f34540769c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f346814cd60 0x7f34681e33f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34680b6f20 0x7f3468145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 --2- 172.21.15.33:0/1367268223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3468073150 0x7f346813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 >> 172.21.15.33:0/1367268223 conn(0x7f34680bbeb0 msgr2=0x7f346806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 shutdown_connections 2024-04-25T15:20:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.250+0000 7f346f492640 1 -- 172.21.15.33:0/1367268223 wait complete. 2024-04-25T15:20:55.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:20:55.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.373+0000 7ffa6ec49640 1 Processor -- start 2024-04-25T15:20:55.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.373+0000 7ffa6ec49640 1 -- start start 2024-04-25T15:20:55.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.374+0000 7ffa6ec49640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.374+0000 7ffa6ec49640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa680bc140 0x7ffa68140320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.374+0000 7ffa6ec49640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa680b7580 con 0x7ffa68140860 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.374+0000 7ffa6ec49640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffa68140c70 con 0x7ffa680bc140 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.374+0000 7ffa6ec49640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa680b7860 con 0x7ffa680b6d70 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa6c9e5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa67fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffa680bc140 0x7ffa68140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa6c9e5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:58546/0 (socket says 172.21.15.33:58546) 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa6c9e5640 1 -- 172.21.15.33:0/1273417631 learned_addr learned my addr 172.21.15.33:0/1273417631 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa6c9e5640 1 -- 172.21.15.33:0/1273417631 >> v2:172.21.15.155:3300/0 conn(0x7ffa680bc140 msgr2=0x7ffa68140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa6c9e5640 1 --2- 172.21.15.33:0/1273417631 >> v2:172.21.15.155:3300/0 conn(0x7ffa680bc140 0x7ffa68140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa6c9e5640 1 -- 172.21.15.33:0/1273417631 >> v1:172.21.15.155:6789/0 conn(0x7ffa68140860 legacy=0x7ffa68146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa6c9e5640 1 -- 172.21.15.33:0/1273417631 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680b7b40 con 0x7ffa680b6d70 2024-04-25T15:20:55.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.375+0000 7ffa67fff640 1 --2- 172.21.15.33:0/1273417631 >> v2:172.21.15.155:3300/0 conn(0x7ffa680bc140 0x7ffa68140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:20:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.376+0000 7ffa6c9e5640 1 --2- 172.21.15.33:0/1273417631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b6290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009870 tx=0x7ffa5002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7104ebae3038e16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.376+0000 7ffa677fe640 1 -- 172.21.15.33:0/1273417631 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50037070 con 0x7ffa680b6d70 2024-04-25T15:20:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.376+0000 7ffa677fe640 1 -- 172.21.15.33:0/1273417631 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa50032440 con 0x7ffa680b6d70 2024-04-25T15:20:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.376+0000 7ffa677fe640 1 -- 172.21.15.33:0/1273417631 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50032810 con 0x7ffa680b6d70 2024-04-25T15:20:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.377+0000 7ffa6ec49640 1 -- 172.21.15.33:0/1273417631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 msgr2=0x7ffa680b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.377+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/1273417631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b6290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009870 tx=0x7ffa5002a1c0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.377+0000 7ffa6ec49640 1 -- 172.21.15.33:0/1273417631 shutdown_connections 2024-04-25T15:20:55.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.377+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/1273417631 >> v2:172.21.15.155:3300/0 conn(0x7ffa680bc140 0x7ffa68140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.377+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/1273417631 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b6290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.377+0000 7ffa6ec49640 1 -- 172.21.15.33:0/1273417631 >> 172.21.15.33:0/1273417631 conn(0x7ffa680b8b10 msgr2=0x7ffa680bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.377+0000 7ffa6ec49640 1 -- 172.21.15.33:0/1273417631 shutdown_connections 2024-04-25T15:20:55.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.377+0000 7ffa6ec49640 1 -- 172.21.15.33:0/1273417631 wait complete. 2024-04-25T15:20:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.378+0000 7ffa6ec49640 1 Processor -- start 2024-04-25T15:20:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.378+0000 7ffa6ec49640 1 -- start start 2024-04-25T15:20:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6ec49640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6ec49640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa680bc140 0x7ffa68138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6ec49640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa68140860 0x7ffa68136910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6ec49640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68146d30 con 0x7ffa68140860 2024-04-25T15:20:55.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6ec49640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa680bc550 con 0x7ffa680bc140 2024-04-25T15:20:55.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6ec49640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa68146eb0 con 0x7ffa680b6d70 2024-04-25T15:20:55.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6d1e6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa68140860 0x7ffa68136910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6d1e6640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa68140860 0x7ffa68136910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49118/0 (socket says 172.21.15.33:49118) 2024-04-25T15:20:55.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6d1e6640 1 -- 172.21.15.33:0/3302232302 learned_addr learned my addr 172.21.15.33:0/3302232302 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa67fff640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa680bc140 0x7ffa68138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.379+0000 7ffa6c9e5640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa6d1e6640 1 -- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 msgr2=0x7ffa680b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa6d1e6640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa6d1e6640 1 -- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa680bc140 msgr2=0x7ffa68138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa6d1e6640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa680bc140 0x7ffa68138c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa6d1e6640 1 -- 172.21.15.33:0/3302232302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6813f320 con 0x7ffa68140860 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa6d1e6640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa68140860 0x7ffa68136910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c760 tx=0x7ffa6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa657fa640 1 -- 172.21.15.33:0/3302232302 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60003b70 con 0x7ffa68140860 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa657fa640 1 -- 172.21.15.33:0/3302232302 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60003d10 con 0x7ffa68140860 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa680b58f0 con 0x7ffa68140860 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa657fa640 1 -- 172.21.15.33:0/3302232302 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000aa90 con 0x7ffa68140860 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.380+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa681e0330 con 0x7ffa68140860 2024-04-25T15:20:55.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.381+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa680764e0 con 0x7ffa68140860 2024-04-25T15:20:55.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.382+0000 7ffa657fa640 1 -- 172.21.15.33:0/3302232302 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffa6000ac30 con 0x7ffa68140860 2024-04-25T15:20:55.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.382+0000 7ffa657fa640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ffa480744e0 0x7ffa480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.382+0000 7ffa657fa640 1 -- 172.21.15.33:0/3302232302 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa60094e80 con 0x7ffa68140860 2024-04-25T15:20:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.383+0000 7ffa6c9e5640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ffa480744e0 0x7ffa480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.383+0000 7ffa6c9e5640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ffa480744e0 0x7ffa480769f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa50034000 tx=0x7ffa5002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.387+0000 7ffa657fa640 1 -- 172.21.15.33:0/3302232302 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa6005f060 con 0x7ffa68140860 2024-04-25T15:20:55.577 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.575+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa6813f0d0 con 0x7ffa68140860 2024-04-25T15:20:55.578 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.577+0000 7ffa657fa640 1 -- 172.21.15.33:0/3302232302 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7ffa60063360 con 0x7ffa68140860 2024-04-25T15:20:55.579 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:55.579 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:20:43.397488+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ffa480744e0 msgr2=0x7ffa480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ffa480744e0 0x7ffa480769f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa50034000 tx=0x7ffa5002e000 comp rx=0 tx=0).stop 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa68140860 msgr2=0x7ffa68136910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa68140860 0x7ffa68136910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000c760 tx=0x7ffa6000cc20 comp rx=0 tx=0).stop 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 shutdown_connections 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ffa480744e0 0x7ffa480769f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa68140860 0x7ffa68136910 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa680bc140 0x7ffa68138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 --2- 172.21.15.33:0/3302232302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa680b6d70 0x7ffa680b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 >> 172.21.15.33:0/3302232302 conn(0x7ffa680b8b10 msgr2=0x7ffa68144ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:55.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 shutdown_connections 2024-04-25T15:20:55.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.579+0000 7ffa6ec49640 1 -- 172.21.15.33:0/3302232302 wait complete. 2024-04-25T15:20:55.592 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:20:55.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.702+0000 7f2eb6584640 1 Processor -- start 2024-04-25T15:20:55.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.702+0000 7f2eb6584640 1 -- start start 2024-04-25T15:20:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eb6584640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2eb00bd100 0x7f2eb006d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eb6584640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2eb01497d0 0x7f2eb009d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eb6584640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb0149e40 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eb6584640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb014a490 con 0x7f2eb01497d0 2024-04-25T15:20:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eb6584640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb00bdfc0 con 0x7f2eb00bd100 2024-04-25T15:20:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eaffff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f2eb00bdbb0 0x7f2eb00bc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:36032/0 (socket says 172.21.15.33:36032) 2024-04-25T15:20:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eaf7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2eb00bd100 0x7f2eb006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eaffff640 1 -- 172.21.15.33:0/1360614278 learned_addr learned my addr 172.21.15.33:0/1360614278 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.703+0000 7f2eb4b21640 1 --2- 172.21.15.33:0/1360614278 >> v2:172.21.15.33:3300/0 conn(0x7f2eb01497d0 0x7f2eb009d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.704+0000 7f2eaf7fe640 1 -- 172.21.15.33:0/1360614278 >> v2:172.21.15.33:3300/0 conn(0x7f2eb01497d0 msgr2=0x7f2eb009d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.704+0000 7f2eaf7fe640 1 --2- 172.21.15.33:0/1360614278 >> v2:172.21.15.33:3300/0 conn(0x7f2eb01497d0 0x7f2eb009d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.704+0000 7f2eaf7fe640 1 -- 172.21.15.33:0/1360614278 >> v1:172.21.15.155:6789/0 conn(0x7f2eb00bdbb0 legacy=0x7f2eb00bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.704+0000 7f2eaf7fe640 1 -- 172.21.15.33:0/1360614278 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb014a120 con 0x7f2eb00bd100 2024-04-25T15:20:55.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.704+0000 7f2eaf7fe640 1 --2- 172.21.15.33:0/1360614278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 0x7f2eb006d380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00bd510 tx=0x7f2ea002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d37ec1917fb4d1fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eaeffd640 1 -- 172.21.15.33:0/1360614278 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0037070 con 0x7f2eb00bd100 2024-04-25T15:20:55.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eaeffd640 1 -- 172.21.15.33:0/1360614278 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea0032440 con 0x7f2eb00bd100 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eaeffd640 1 -- 172.21.15.33:0/1360614278 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea002ae60 con 0x7f2eb00bd100 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eb6584640 1 -- 172.21.15.33:0/1360614278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 msgr2=0x7f2eb006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eb6584640 1 --2- 172.21.15.33:0/1360614278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 0x7f2eb006d380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00bd510 tx=0x7f2ea002a110 comp rx=0 tx=0).stop 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eb6584640 1 -- 172.21.15.33:0/1360614278 shutdown_connections 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eb6584640 1 --2- 172.21.15.33:0/1360614278 >> v2:172.21.15.33:3300/0 conn(0x7f2eb01497d0 0x7f2eb009d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eb6584640 1 --2- 172.21.15.33:0/1360614278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 0x7f2eb006d380 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eb6584640 1 -- 172.21.15.33:0/1360614278 >> 172.21.15.33:0/1360614278 conn(0x7f2eb00bedd0 msgr2=0x7f2eb00bf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eb6584640 1 -- 172.21.15.33:0/1360614278 shutdown_connections 2024-04-25T15:20:55.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.705+0000 7f2eb6584640 1 -- 172.21.15.33:0/1360614278 wait complete. 2024-04-25T15:20:55.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.707+0000 7f2eb6584640 1 Processor -- start 2024-04-25T15:20:55.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.707+0000 7f2eb6584640 1 -- start start 2024-04-25T15:20:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eb6584640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 0x7f2eb00b8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eb6584640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eb00bdbb0 0x7f2eb01e2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eb6584640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb01497d0 0x7f2eb0145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eb6584640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb009dcb0 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eb6584640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb009db30 con 0x7f2eb00bd100 2024-04-25T15:20:55.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eb6584640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb0149be0 con 0x7f2eb01497d0 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eb00bdbb0 0x7f2eb01e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaf7fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eb00bdbb0 0x7f2eb01e2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49132/0 (socket says 172.21.15.33:49132) 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 0x7f2eb00b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaf7fe640 1 -- 172.21.15.33:0/2385649498 learned_addr learned my addr 172.21.15.33:0/2385649498 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eb4b21640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb01497d0 0x7f2eb0145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaf7fe640 1 -- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb01497d0 msgr2=0x7f2eb0145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaf7fe640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb01497d0 0x7f2eb0145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaf7fe640 1 -- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 msgr2=0x7f2eb00b8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaf7fe640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 0x7f2eb00b8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.708+0000 7f2eaf7fe640 1 -- 172.21.15.33:0/2385649498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb00b1f40 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.709+0000 7f2eaf7fe640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eb00bdbb0 0x7f2eb01e2700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009890 tx=0x7f2ea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.709+0000 7f2eacff9640 1 -- 172.21.15.33:0/2385649498 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0037040 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.709+0000 7f2eacff9640 1 -- 172.21.15.33:0/2385649498 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea0042070 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.709+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb00b2310 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.709+0000 7f2eacff9640 1 -- 172.21.15.33:0/2385649498 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0030960 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.709+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb00b2c20 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.710+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb00764e0 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.710+0000 7f2eacff9640 1 -- 172.21.15.33:0/2385649498 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2ea0030b00 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.711+0000 7f2eacff9640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2e900744b0 0x7f2e900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.711+0000 7f2eacff9640 1 -- 172.21.15.33:0/2385649498 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2ea00b5b80 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.711+0000 7f2eaffff640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2e900744b0 0x7f2e900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.712+0000 7f2eaffff640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2e900744b0 0x7f2e900769c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e98005880 tx=0x7f2e98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:55.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.715+0000 7f2eacff9640 1 -- 172.21.15.33:0/2385649498 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ea007fc20 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.939+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2eb00b2140 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.939+0000 7f2eacff9640 1 -- 172.21.15.33:0/2385649498 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3524 (secure 0 0 0) 0x7f2ea0083f20 con 0x7f2eb00bdbb0 2024-04-25T15:20:55.941 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:20:55.941 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2065139550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2065139550},{"type":"v1","addr":"172.21.15.155:6835","nonce":2065139550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:20:41.780676+0000","modified":"2024-04-25T15:20:44.800148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/23089112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":23089112},{"type":"v1","addr":"172.21.15.33:6833","nonce":23089112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-04-25T15:20:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-04-25T15:20:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2e900744b0 msgr2=0x7f2e900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2e900744b0 0x7f2e900769c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2e98005880 tx=0x7f2e98009040 comp rx=0 tx=0).stop 2024-04-25T15:20:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eb00bdbb0 msgr2=0x7f2eb01e2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eb00bdbb0 0x7f2eb01e2700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009890 tx=0x7f2ea00046c0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 shutdown_connections 2024-04-25T15:20:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f2e900744b0 0x7f2e900769c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb01497d0 0x7f2eb0145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eb00bdbb0 0x7f2eb01e2700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 --2- 172.21.15.33:0/2385649498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb00bd100 0x7f2eb00b8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.941+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 >> 172.21.15.33:0/2385649498 conn(0x7f2eb00bedd0 msgr2=0x7f2eb0148350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.942+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 shutdown_connections 2024-04-25T15:20:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:55.942+0000 7f2eb6584640 1 -- 172.21.15.33:0/2385649498 wait complete. 2024-04-25T15:20:56.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T15:20:41.780676+0000', 'modified': '2024-04-25T15:20:44.800148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6833/23089112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6832', 'nonce': 23089112}, {'type': 'v1', 'addr': '172.21.15.33:6833', 'nonce': 23089112}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4269, 'qdb_cluster': [4269]} 2024-04-25T15:20:56.156 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T15:20:56.156 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T15:20:56.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.266+0000 7faa87500640 1 Processor -- start 2024-04-25T15:20:56.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.267+0000 7faa87500640 1 -- start start 2024-04-25T15:20:56.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa87500640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faa800b6290 0x7faa800bc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa87500640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa800b7580 con 0x7faa80146620 2024-04-25T15:20:56.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa87500640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa800b7860 con 0x7faa800b6d70 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa87500640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7faa800b7b40 con 0x7faa800b6290 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa85a9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faa80146620 0x7faa80146a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51656/0 (socket says 172.21.15.33:51656) 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa85a9d640 1 -- 172.21.15.33:0/1604099226 learned_addr learned my addr 172.21.15.33:0/1604099226 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa84a9b640 1 --2- 172.21.15.33:0/1604099226 >> v2:172.21.15.155:3300/0 conn(0x7faa800b6290 0x7faa800bc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472619852 0 0) 0x7faa800b7580 con 0x7faa80146620 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa68003520 con 0x7faa80146620 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 800660522 0 0) 0x7faa68003520 con 0x7faa80146620 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 >> v2:172.21.15.155:3300/0 conn(0x7faa800b6290 msgr2=0x7faa800bc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 --2- 172.21.15.33:0/1604099226 >> v2:172.21.15.155:3300/0 conn(0x7faa800b6290 0x7faa800bc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 >> v1:172.21.15.155:6789/0 conn(0x7faa800b6d70 legacy=0x7faa80140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa800b7e20 con 0x7faa80146620 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7faa78001670 con 0x7faa80146620 2024-04-25T15:20:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 >> v1:172.21.15.33:6789/0 conn(0x7faa80146620 legacy=0x7faa80146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa680039b0 0x7faa68003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa68004800 0x7faa68004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.268+0000 7faa7ffff640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faa800b7b40 con 0x7faa68005250 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faa6800c1e0 con 0x7faa680039b0 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faa6800c3e0 con 0x7faa68004800 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa85a9d640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa8529c640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa680039b0 0x7faa68003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa84a9b640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa68004800 0x7faa68004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa85a9d640 1 -- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa68004800 msgr2=0x7faa68004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa85a9d640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa68004800 0x7faa68004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa85a9d640 1 -- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa680039b0 msgr2=0x7faa68003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa85a9d640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa680039b0 0x7faa68003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa85a9d640 1 -- 172.21.15.33:0/1604099226 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa68003520 con 0x7faa68005250 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa84a9b640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa68004800 0x7faa68004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.269+0000 7faa85a9d640 1 -- 172.21.15.33:0/1604099226 reap_dead start 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa85a9d640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa6800b9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faa7800c240 tx=0x7faa68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785d89a6287bc157 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78007d10 con 0x7faa68005250 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa78005ad0 con 0x7faa68005250 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa7ffff640 1 -- 172.21.15.33:0/1604099226 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78007070 con 0x7faa68005250 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa87500640 1 -- 172.21.15.33:0/1604099226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 msgr2=0x7faa6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa87500640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa6800b9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faa7800c240 tx=0x7faa68005830 comp rx=0 tx=0).stop 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa87500640 1 -- 172.21.15.33:0/1604099226 shutdown_connections 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa87500640 1 --2- 172.21.15.33:0/1604099226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa6800b9c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.270+0000 7faa87500640 1 -- 172.21.15.33:0/1604099226 >> 172.21.15.33:0/1604099226 conn(0x7faa800b8b10 msgr2=0x7faa800bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.271+0000 7faa87500640 1 -- 172.21.15.33:0/1604099226 shutdown_connections 2024-04-25T15:20:56.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.271+0000 7faa87500640 1 -- 172.21.15.33:0/1604099226 wait complete. 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.272+0000 7faa87500640 1 Processor -- start 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.272+0000 7faa87500640 1 -- start start 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa87500640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa801db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa87500640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa8013c2c0 0x7faa80145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa87500640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa800b5690 0x7faa801379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa87500640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7faa800bc4d0 con 0x7faa68005250 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa87500640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faa800bc350 con 0x7faa8013c2c0 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa87500640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faa80146a30 con 0x7faa800b5690 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa8529c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa801db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa8529c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa801db0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49152/0 (socket says 172.21.15.33:49152) 2024-04-25T15:20:56.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa8529c640 1 -- 172.21.15.33:0/2139405238 learned_addr learned my addr 172.21.15.33:0/2139405238 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa84a9b640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa8013c2c0 0x7faa80145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa85a9d640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa800b5690 0x7faa801379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa8529c640 1 -- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa800b5690 msgr2=0x7faa801379b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa8529c640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa800b5690 0x7faa801379b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa8529c640 1 -- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa8013c2c0 msgr2=0x7faa80145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa8529c640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa8013c2c0 0x7faa80145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.273+0000 7faa8529c640 1 -- 172.21.15.33:0/2139405238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa800b5bb0 con 0x7faa68005250 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.274+0000 7faa8529c640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa801db0b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faa7000f990 tx=0x7faa7000fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.274+0000 7faa7dffb640 1 -- 172.21.15.33:0/2139405238 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70003b80 con 0x7faa68005250 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.274+0000 7faa7dffb640 1 -- 172.21.15.33:0/2139405238 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa70018070 con 0x7faa68005250 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.274+0000 7faa87500640 1 -- 172.21.15.33:0/2139405238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8013bb00 con 0x7faa68005250 2024-04-25T15:20:56.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.274+0000 7faa7dffb640 1 -- 172.21.15.33:0/2139405238 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7000d770 con 0x7faa68005250 2024-04-25T15:20:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.274+0000 7faa87500640 1 -- 172.21.15.33:0/2139405238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa80145880 con 0x7faa68005250 2024-04-25T15:20:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.276+0000 7faa7dffb640 1 -- 172.21.15.33:0/2139405238 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7faa7000d910 con 0x7faa68005250 2024-04-25T15:20:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.276+0000 7faa7dffb640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faa6c0744e0 0x7faa6c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.276+0000 7faa7dffb640 1 -- 172.21.15.33:0/2139405238 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa700952e0 con 0x7faa68005250 2024-04-25T15:20:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.276+0000 7faa84a9b640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faa6c0744e0 0x7faa6c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.277+0000 7faa84a9b640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faa6c0744e0 0x7faa6c0769f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa80148940 tx=0x7faa74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.277+0000 7faa8e3b4740 1 Processor -- start 2024-04-25T15:20:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.277+0000 7faa8e3b4740 1 -- start start 2024-04-25T15:20:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd4747550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd437d3b0 0x555bd47433b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd4385590 0x555bd476efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555bd46ac740 con 0x555bd437d3b0 2024-04-25T15:20:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555bd46483a0 con 0x555bd4385590 2024-04-25T15:20:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x555bd46a8700 con 0x555bd43a6270 2024-04-25T15:20:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa84a9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd437d3b0 0x555bd47433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa84a9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd437d3b0 0x555bd47433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49164/0 (socket says 172.21.15.33:49164) 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa84a9b640 1 -- 172.21.15.33:0/976661257 learned_addr learned my addr 172.21.15.33:0/976661257 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa8529c640 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd4747550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.278+0000 7faa85a9d640 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd4385590 0x555bd476efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa84a9b640 1 -- 172.21.15.33:0/976661257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 msgr2=0x555bd4747550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa84a9b640 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd4747550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa84a9b640 1 -- 172.21.15.33:0/976661257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd4385590 msgr2=0x555bd476efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa84a9b640 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd4385590 0x555bd476efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa84a9b640 1 -- 172.21.15.33:0/976661257 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd4664750 con 0x555bd437d3b0 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa84a9b640 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd437d3b0 0x555bd47433b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa74004380 tx=0x7faa74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc48b12b9fb08fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa66ffd640 1 -- 172.21.15.33:0/976661257 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74029070 con 0x555bd437d3b0 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa66ffd640 1 -- 172.21.15.33:0/976661257 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7401f050 con 0x555bd437d3b0 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.279+0000 7faa66ffd640 1 -- 172.21.15.33:0/976661257 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74003dd0 con 0x555bd437d3b0 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 -- 172.21.15.33:0/976661257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd437d3b0 msgr2=0x555bd47433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd437d3b0 0x555bd47433b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa74004380 tx=0x7faa74016000 comp rx=0 tx=0).stop 2024-04-25T15:20:56.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 -- 172.21.15.33:0/976661257 shutdown_connections 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd4385590 0x555bd476efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd437d3b0 0x555bd47433b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/976661257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd4747550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 -- 172.21.15.33:0/976661257 >> 172.21.15.33:0/976661257 conn(0x555bd439a3c0 msgr2=0x555bd47463a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 -- 172.21.15.33:0/976661257 shutdown_connections 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.280+0000 7faa8e3b4740 1 -- 172.21.15.33:0/976661257 wait complete. 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.281+0000 7faa8e3b4740 1 -- start start 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.281+0000 7faa8e3b4740 1 Processor -- start 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd4385590 0x555bd47703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd43a6270 0x555bd4770930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555bd4747a90 con 0x555bd43a6270 2024-04-25T15:20:56.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555bd4633fe0 con 0x555bd437d3b0 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x555bd47895d0 con 0x555bd4385590 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8e3b4740 10 client.0 _ll_register_callbacks cb 0x555bd464a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa85a9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd43a6270 0x555bd4770930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa85a9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd43a6270 0x555bd4770930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49174/0 (socket says 172.21.15.33:49174) 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa85a9d640 1 -- 172.21.15.33:0/3839438906 learned_addr learned my addr 172.21.15.33:0/3839438906 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8529c640 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa84a9b640 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd4385590 0x555bd47703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa85a9d640 1 -- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd4385590 msgr2=0x555bd47703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa85a9d640 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd4385590 0x555bd47703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa85a9d640 1 -- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 msgr2=0x555bd4788c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa85a9d640 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa85a9d640 1 -- 172.21.15.33:0/3839438906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd43be2d0 con 0x555bd43a6270 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.282+0000 7faa8529c640 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:20:56.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa85a9d640 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd43a6270 0x555bd4770930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa7802ae20 tx=0x7faa7802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873f25cee89c311c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa5ffff640 1 -- 172.21.15.33:0/3839438906 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78007d10 con 0x555bd43a6270 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa5ffff640 1 -- 172.21.15.33:0/3839438906 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa78004d10 con 0x555bd43a6270 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3839438906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa7401f050 con 0x555bd43a6270 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa5ffff640 1 -- 172.21.15.33:0/3839438906 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7faa7804e050 con 0x555bd43a6270 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 10 client.4662 fetch_fsmap learned FSMap version 8 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3839438906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x555bd44886b0 con 0x555bd43a6270 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa5ffff640 1 -- 172.21.15.33:0/3839438906 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7401f050 con 0x555bd43a6270 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa5ffff640 1 -- 172.21.15.33:0/3839438906 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7faa78051020 con 0x555bd43a6270 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 10 client.4662 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 20 client.4662 populate_metadata read hostname 'smithi033' 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] conn(0x555bd4364e40 0x555bd4763810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 4 client.4662 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T15:20:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3839438906 --> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bd46ba350 con 0x555bd4364e40 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.283+0000 7faa8529c640 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] conn(0x555bd4364e40 0x555bd4763810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.284+0000 7faa5ffff640 10 client.4662 ms_handle_connect on v2:172.21.15.33:6832/23089112 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.284+0000 7faa8529c640 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] conn(0x555bd4364e40 0x555bd4763810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=518a877df561fea9 server_cookie=4f884e75bd8e26a4 in_seq=0 out_seq=0 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.284+0000 7faa5ffff640 1 -- 172.21.15.33:0/3839438906 <== mds.0 v2:172.21.15.33:6832/23089112 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555bd46ba350 con 0x555bd4364e40 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.284+0000 7faa5ffff640 10 client.4662 handle_command_reply: tid=0 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.284+0000 7faa8e3b4740 1 client.4662 shutdown 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3839438906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd43a6270 msgr2=0x555bd4770930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd43a6270 0x555bd4770930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faa7802ae20 tx=0x7faa7802d000 comp rx=0 tx=0).stop 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3839438906 shutdown_connections 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] conn(0x555bd4364e40 0x555bd4763810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd43a6270 0x555bd4770930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd4385590 0x555bd47703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3839438906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa5ffff640 0 client.4662 ms_handle_reset on v2:172.21.15.33:6832/23089112 2024-04-25T15:20:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3839438906 >> 172.21.15.33:0/3839438906 conn(0x555bd439a3c0 msgr2=0x555bd476d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:56.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3839438906 shutdown_connections 2024-04-25T15:20:56.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3839438906 wait complete. 2024-04-25T15:20:56.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.285+0000 7faa8e3b4740 20 client.4662 trim_cache size 0 max 16384 2024-04-25T15:20:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.304+0000 7faa8e3b4740 1 Processor -- start 2024-04-25T15:20:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.304+0000 7faa8e3b4740 1 -- start start 2024-04-25T15:20:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd47997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd476d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555bd4771e80 con 0x555bd4385590 2024-04-25T15:20:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faa801e8370 con 0x555bd437d3b0 2024-04-25T15:20:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faa801e74d0 con 0x555bd43a6270 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd47997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd47997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49190/0 (socket says 172.21.15.33:49190) 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 -- 172.21.15.33:0/3278328647 learned_addr learned my addr 172.21.15.33:0/3278328647 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa8529c640 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa85a9d640 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd476d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 -- 172.21.15.33:0/3278328647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 msgr2=0x555bd476d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd476d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 -- 172.21.15.33:0/3278328647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 msgr2=0x555bd4788da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 -- 172.21.15.33:0/3278328647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd4776930 con 0x555bd4385590 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.305+0000 7faa84a9b640 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd47997f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa74024000 tx=0x7faa74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c814ff071495aabf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa667fc640 1 -- 172.21.15.33:0/3278328647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74035070 con 0x555bd4385590 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa667fc640 1 -- 172.21.15.33:0/3278328647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7402a040 con 0x555bd4385590 2024-04-25T15:20:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa667fc640 1 -- 172.21.15.33:0/3278328647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74029070 con 0x555bd4385590 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3278328647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 msgr2=0x555bd47997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd47997f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa74024000 tx=0x7faa74018000 comp rx=0 tx=0).stop 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3278328647 shutdown_connections 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd476d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd47997f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/3278328647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd4788da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3278328647 >> 172.21.15.33:0/3278328647 conn(0x555bd439a3c0 msgr2=0x555bd47742f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3278328647 shutdown_connections 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.306+0000 7faa8e3b4740 1 -- 172.21.15.33:0/3278328647 wait complete. 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.307+0000 7faa8e3b4740 1 -- start start 2024-04-25T15:20:56.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.307+0000 7faa8e3b4740 1 Processor -- start 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd47f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd478f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa8e3b4740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd476e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x555bd47764d0 con 0x555bd4385590 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555bd4789310 con 0x555bd437d3b0 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa8e3b4740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x555bd4777ba0 con 0x555bd43a6270 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa8e3b4740 10 client.0 _ll_register_callbacks cb 0x7faa74009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa84a9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd478f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa84a9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd478f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49198/0 (socket says 172.21.15.33:49198) 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa84a9b640 1 -- 172.21.15.33:0/667494590 learned_addr learned my addr 172.21.15.33:0/667494590 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:20:56.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa8529c640 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd47f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.308+0000 7faa85a9d640 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd476e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa84a9b640 1 -- 172.21.15.33:0/667494590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 msgr2=0x555bd476e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa84a9b640 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd476e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa84a9b640 1 -- 172.21.15.33:0/667494590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 msgr2=0x555bd47f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa84a9b640 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd47f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa84a9b640 1 -- 172.21.15.33:0/667494590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd4741cc0 con 0x555bd4385590 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa84a9b640 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd478f430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa740040b0 tx=0x7faa74004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27aec821e8efebd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-04-25T15:20:56.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa5ffff640 1 -- 172.21.15.33:0/667494590 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74029070 con 0x555bd4385590 2024-04-25T15:20:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa5ffff640 1 -- 172.21.15.33:0/667494590 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa74003c90 con 0x555bd4385590 2024-04-25T15:20:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa8e3b4740 1 -- 172.21.15.33:0/667494590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa7402a040 con 0x555bd4385590 2024-04-25T15:20:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa5ffff640 1 -- 172.21.15.33:0/667494590 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7faa74040050 con 0x555bd4385590 2024-04-25T15:20:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa8e3b4740 10 client.4668 fetch_fsmap learned FSMap version 8 2024-04-25T15:20:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa8e3b4740 1 -- 172.21.15.33:0/667494590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x555bd47ed510 con 0x555bd4385590 2024-04-25T15:20:56.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa5ffff640 1 -- 172.21.15.33:0/667494590 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7402a040 con 0x555bd4385590 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.309+0000 7faa5ffff640 1 -- 172.21.15.33:0/667494590 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 8) ==== 2284+0+0 (secure 0 0 0) 0x7faa74043020 con 0x555bd4385590 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 10 client.4668 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 10 client.4668 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 20 client.4668 populate_metadata read hostname 'smithi033' 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] conn(0x555bd47f6d40 0x555bd476ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 4 client.4668 mds_command: new command op to 4269 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 1 -- 172.21.15.33:0/667494590 --> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] -- command(tid 0: {"prefix": "status"}) -- 0x555bd46b41c0 con 0x555bd47f6d40 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8529c640 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] conn(0x555bd47f6d40 0x555bd476ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa5ffff640 10 client.4668 ms_handle_connect on v2:172.21.15.33:6832/23089112 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8529c640 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] conn(0x555bd47f6d40 0x555bd476ecc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7310ec3aebc83854 server_cookie=a2c7a866b8e5d54a in_seq=0 out_seq=0 2024-04-25T15:20:56.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa5ffff640 1 -- 172.21.15.33:0/667494590 <== mds.0 v2:172.21.15.33:6832/23089112 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x555bd46b41c0 con 0x555bd47f6d40 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa5ffff640 10 client.4668 handle_command_reply: tid=0 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 1 client.4668 shutdown 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 1 -- 172.21.15.33:0/667494590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 msgr2=0x555bd478f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.310+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd478f430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa740040b0 tx=0x7faa74004730 comp rx=0 tx=0).stop 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 1 -- 172.21.15.33:0/667494590 shutdown_connections 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.33:6832/23089112,v1:172.21.15.33:6833/23089112] conn(0x555bd47f6d40 0x555bd476ecc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x555bd43a6270 0x555bd476e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555bd4385590 0x555bd478f430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa5ffff640 0 client.4668 ms_handle_reset on v2:172.21.15.33:6832/23089112 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 1 --2- 172.21.15.33:0/667494590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555bd437d3b0 0x555bd47f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 1 -- 172.21.15.33:0/667494590 >> 172.21.15.33:0/667494590 conn(0x555bd439a3c0 msgr2=0x555bd476d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 1 -- 172.21.15.33:0/667494590 shutdown_connections 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 1 -- 172.21.15.33:0/667494590 wait complete. 2024-04-25T15:20:56.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa8e3b4740 20 client.4668 trim_cache size 0 max 16384 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "674605f9-f613-4a95-b0f3-ac5870429d94", 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4269, 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 13.899258368, 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 8, 2024-04-25T15:20:56.320 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 20, 2024-04-25T15:20:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 20, 2024-04-25T15:20:56.321 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 20.947792277000001 2024-04-25T15:20:56.321 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 -- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faa6c0744e0 msgr2=0x7faa6c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faa6c0744e0 0x7faa6c0769f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faa80148940 tx=0x7faa74008040 comp rx=0 tx=0).stop 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 -- 172.21.15.33:0/2139405238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 msgr2=0x7faa801db0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa801db0b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faa7000f990 tx=0x7faa7000fe50 comp rx=0 tx=0).stop 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 -- 172.21.15.33:0/2139405238 shutdown_connections 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7faa6c0744e0 0x7faa6c0769f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa800b5690 0x7faa801379b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa8013c2c0 0x7faa80145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 --2- 172.21.15.33:0/2139405238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa68005250 0x7faa801db0b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:20:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 -- 172.21.15.33:0/2139405238 >> 172.21.15.33:0/2139405238 conn(0x7faa800b8b10 msgr2=0x7faa8013d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:20:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 -- 172.21.15.33:0/2139405238 shutdown_connections 2024-04-25T15:20:56.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:20:56.311+0000 7faa87500640 1 -- 172.21.15.33:0/2139405238 wait complete. 2024-04-25T15:20:56.324 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T15:20:56.334 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T15:20:56.334 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T15:20:56.335 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T15:20:56.335 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-25T15:20:56.410 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T15:20:56.482 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:20:56.482 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T15:20:56.482 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:20:56.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:20:56.498 INFO:teuthology.orchestra.run.smithi033.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T15:20:56.499 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:20:56.554 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-25T15:20:56.555 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-25T15:20:56.610 INFO:tasks.workunit:timeout=3h 2024-04-25T15:20:56.610 INFO:tasks.workunit:cleanup=True 2024-04-25T15:20:56.611 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T15:20:56.667 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T15:21:07.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:21:07.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:21:37.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:21:37.141 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:22:07.267 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:22:07.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:22:26.405 INFO:tasks.workunit.client.0.smithi033.stderr:Updating files: 91% (11196/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-04-25T15:22:27.067 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-04-25T15:22:27.068 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-04-25T15:22:27.068 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-04-25T15:22:27.068 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-04-25T15:22:27.068 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-04-25T15:22:27.068 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-04-25T15:22:27.068 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T15:22:27.068 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-04-25T15:22:27.068 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T15:22:27.073 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T15:22:27.102 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T15:22:27.103 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T15:22:27.103 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T15:22:27.671 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T15:22:27.725 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T15:22:27.766 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T15:22:27.767 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T15:22:27.767 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T15:22:27.807 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T15:22:27.811 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-04-25T15:22:27.811 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T15:22:27.868 INFO:tasks.workunit:Running workunits matching libcephfs/test.sh on client.0... 2024-04-25T15:22:27.871 INFO:tasks.workunit:Running workunit libcephfs/test.sh... 2024-04-25T15:22:27.871 DEBUG:teuthology.orchestra.run.smithi033:workunit test libcephfs/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2024-04-25T15:22:27.976 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 126 tests from 4 test suites. 2024-04-25T15:22:27.976 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-04-25T15:22:27.976 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 117 tests from LibCephFS 2024-04-25T15:22:27.977 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LayoutVerifyDefaultLayout 2024-04-25T15:22:28.002 INFO:tasks.workunit.client.0.smithi033.stderr:layout:{"stripe_unit": 4194304, "stripe_count": 1, "object_size": 4194304, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@default"} 2024-04-25T15:22:28.018 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LayoutVerifyDefaultLayout (42 ms) 2024-04-25T15:22:28.019 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout 2024-04-25T15:22:28.049 INFO:tasks.workunit.client.0.smithi033.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@set"} 2024-04-25T15:22:28.049 INFO:tasks.workunit.client.0.smithi033.stderr:layout:{"stripe_unit": 65536, "stripe_count": 1, "object_size": 65536, "pool_name": "cephfs_data", "pool_id": 3, "pool_namespace": "", "inheritance": "@inherited"} 2024-04-25T15:22:28.067 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LayoutSetAndVerifyNewAndInheritedLayout (49 ms) 2024-04-25T15:22:28.068 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LayoutSetBadJSON 2024-04-25T15:22:28.111 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LayoutSetBadJSON (44 ms) 2024-04-25T15:22:28.112 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolName 2024-04-25T15:22:28.160 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LayoutSetBadPoolName (49 ms) 2024-04-25T15:22:28.160 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LayoutSetBadPoolId 2024-04-25T15:22:28.203 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LayoutSetBadPoolId (43 ms) 2024-04-25T15:22:28.203 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LayoutSetInvalidFieldName 2024-04-25T15:22:28.248 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LayoutSetInvalidFieldName (45 ms) 2024-04-25T15:22:28.249 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.GetAndSetDirPin 2024-04-25T15:22:28.294 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.GetAndSetDirPin (47 ms) 2024-04-25T15:22:28.294 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.GetAndSetDirDistribution 2024-04-25T15:22:28.335 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.GetAndSetDirDistribution (40 ms) 2024-04-25T15:22:28.335 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.GetAndSetDirRandom 2024-04-25T15:22:28.374 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.GetAndSetDirRandom (39 ms) 2024-04-25T15:22:28.374 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DelegMultiClient 2024-04-25T15:22:28.709 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DelegMultiClient (335 ms) 2024-04-25T15:22:28.709 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DelegSingleClient 2024-04-25T15:22:28.880 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DelegSingleClient (165 ms) 2024-04-25T15:22:28.880 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DelegTimeout 2024-04-25T15:22:33.949 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DelegTimeout (5073 ms) 2024-04-25T15:22:33.951 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.RecalledGetattr 2024-04-25T15:22:34.027 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.RecalledGetattr (80 ms) 2024-04-25T15:22:34.027 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.BasicRecordLocking 2024-04-25T15:22:34.064 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.BasicRecordLocking (37 ms) 2024-04-25T15:22:34.065 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ConcurrentRecordLocking 2024-04-25T15:22:34.121 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ConcurrentRecordLocking (57 ms) 2024-04-25T15:22:34.121 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ThreesomeRecordLocking 2024-04-25T15:22:34.191 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ThreesomeRecordLocking (70 ms) 2024-04-25T15:22:34.192 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.BasicLocking 2024-04-25T15:22:34.231 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.BasicLocking (40 ms) 2024-04-25T15:22:34.232 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ConcurrentLocking 2024-04-25T15:22:34.291 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ConcurrentLocking (59 ms) 2024-04-25T15:22:34.291 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ThreesomeLocking 2024-04-25T15:22:34.358 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ThreesomeLocking (68 ms) 2024-04-25T15:22:34.359 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.MulticlientSimple 2024-04-25T15:22:34.470 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.MulticlientSimple (112 ms) 2024-04-25T15:22:34.470 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.MulticlientHoleEOF 2024-04-25T15:22:34.543 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.MulticlientHoleEOF (73 ms) 2024-04-25T15:22:34.543 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.MulticlientRevokeCaps 2024-04-25T15:22:37.668 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:22:37.671 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:23:07.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:23:07.733 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:23:34.583 INFO:tasks.workunit.client.0.smithi033.stdout: Will run test for 60 seconds! 2024-04-25T15:23:34.583 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.MulticlientRevokeCaps (60039 ms) 2024-04-25T15:23:34.583 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ReaddirRCB 2024-04-25T15:23:34.634 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ReaddirRCB (52 ms) 2024-04-25T15:23:34.634 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.OpenEmptyComponent 2024-04-25T15:23:34.738 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.OpenEmptyComponent (104 ms) 2024-04-25T15:23:34.738 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.OpenReadTruncate 2024-04-25T15:23:35.376 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.OpenReadTruncate (638 ms) 2024-04-25T15:23:35.377 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.OpenReadWrite 2024-04-25T15:23:35.411 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.OpenReadWrite (35 ms) 2024-04-25T15:23:35.411 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.MountNonExist 2024-04-25T15:23:35.435 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.MountNonExist (24 ms) 2024-04-25T15:23:35.435 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.MountDouble 2024-04-25T15:23:35.459 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.MountDouble (24 ms) 2024-04-25T15:23:35.459 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.MountRemount 2024-04-25T15:23:35.493 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.MountRemount (34 ms) 2024-04-25T15:23:35.493 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.UnmountUnmounted 2024-04-25T15:23:35.503 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.UnmountUnmounted (10 ms) 2024-04-25T15:23:35.504 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ReleaseUnmounted 2024-04-25T15:23:35.515 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ReleaseUnmounted (12 ms) 2024-04-25T15:23:35.515 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ReleaseMounted 2024-04-25T15:23:35.537 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ReleaseMounted (22 ms) 2024-04-25T15:23:35.537 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.UnmountRelease 2024-04-25T15:23:35.559 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.UnmountRelease (22 ms) 2024-04-25T15:23:35.559 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Mount 2024-04-25T15:23:35.604 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Mount (45 ms) 2024-04-25T15:23:35.604 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.OpenLayout 2024-04-25T15:23:35.670 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.OpenLayout (64 ms) 2024-04-25T15:23:35.670 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DirLs 2024-04-25T15:23:37.901 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:23:37.903 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:23:53.041 INFO:tasks.workunit.client.0.smithi033.stdout:rand: 3416 2024-04-25T15:23:53.041 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DirLs (17365 ms) 2024-04-25T15:23:53.041 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ManyNestedDirs 2024-04-25T15:23:53.475 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ManyNestedDirs (442 ms) 2024-04-25T15:23:53.475 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Xattrs 2024-04-25T15:23:53.529 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_a 2024-04-25T15:23:53.529 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_b 2024-04-25T15:23:53.529 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_c 2024-04-25T15:23:53.529 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_d 2024-04-25T15:23:53.529 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_e 2024-04-25T15:23:53.529 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_f 2024-04-25T15:23:53.529 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_g 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_h 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_i 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_j 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_k 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_l 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_m 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_n 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_o 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_p 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_q 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_r 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_s 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_t 2024-04-25T15:23:53.530 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_u 2024-04-25T15:23:53.531 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_v 2024-04-25T15:23:53.531 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_w 2024-04-25T15:23:53.531 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_x 2024-04-25T15:23:53.531 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_y 2024-04-25T15:23:53.531 INFO:tasks.workunit.client.0.smithi033.stdout:getting attr user.test_xattr_z 2024-04-25T15:23:53.627 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Xattrs (152 ms) 2024-04-25T15:23:53.627 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Xattrs_ll 2024-04-25T15:23:53.907 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Xattrs_ll (280 ms) 2024-04-25T15:23:53.907 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LstatSlashdot 2024-04-25T15:23:53.961 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LstatSlashdot (54 ms) 2024-04-25T15:23:53.961 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.StatDirNlink 2024-04-25T15:23:54.080 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.StatDirNlink (119 ms) 2024-04-25T15:23:54.080 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DoubleChmod 2024-04-25T15:23:54.114 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DoubleChmod (34 ms) 2024-04-25T15:23:54.114 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Fchmod 2024-04-25T15:23:54.143 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Fchmod (29 ms) 2024-04-25T15:23:54.143 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Lchmod 2024-04-25T15:23:54.176 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Lchmod (33 ms) 2024-04-25T15:23:54.176 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Fchown 2024-04-25T15:23:54.203 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Fchown (27 ms) 2024-04-25T15:23:54.203 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.FlagO_PATH 2024-04-25T15:23:54.230 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.FlagO_PATH (27 ms) 2024-04-25T15:23:54.230 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Symlinks 2024-04-25T15:23:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Symlinks (57 ms) 2024-04-25T15:23:54.287 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DirSyms 2024-04-25T15:23:54.351 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DirSyms (60 ms) 2024-04-25T15:23:54.351 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LoopSyms 2024-04-25T15:23:54.395 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LoopSyms (48 ms) 2024-04-25T15:23:54.395 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.HardlinkNoOriginal 2024-04-25T15:23:54.493 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.HardlinkNoOriginal (98 ms) 2024-04-25T15:23:54.493 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.BadArgument 2024-04-25T15:23:54.526 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.BadArgument (33 ms) 2024-04-25T15:23:54.526 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.BadFileDesc 2024-04-25T15:23:54.547 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.BadFileDesc (21 ms) 2024-04-25T15:23:54.547 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ReadEmptyFile 2024-04-25T15:23:54.575 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ReadEmptyFile (28 ms) 2024-04-25T15:23:54.575 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.PreadvPwritev 2024-04-25T15:23:54.604 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.PreadvPwritev (29 ms) 2024-04-25T15:23:54.604 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LlreadvLlwritev 2024-04-25T15:23:54.637 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LlreadvLlwritev (33 ms) 2024-04-25T15:23:54.637 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.StripeUnitGran 2024-04-25T15:23:54.659 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.StripeUnitGran (22 ms) 2024-04-25T15:23:54.659 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Rename 2024-04-25T15:23:54.692 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Rename (34 ms) 2024-04-25T15:23:54.692 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.UseUnmounted 2024-04-25T15:23:54.703 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.UseUnmounted (10 ms) 2024-04-25T15:23:54.703 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.GetPoolId 2024-04-25T15:23:54.725 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.GetPoolId (22 ms) 2024-04-25T15:23:54.725 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.GetPoolReplication 2024-04-25T15:23:54.747 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.GetPoolReplication (22 ms) 2024-04-25T15:23:54.747 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.GetExtentOsds 2024-04-25T15:23:54.773 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.GetExtentOsds (26 ms) 2024-04-25T15:23:54.773 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.GetOsdCrushLocation 2024-04-25T15:23:54.799 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.GetOsdCrushLocation (26 ms) 2024-04-25T15:23:54.799 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.GetOsdAddr 2024-04-25T15:23:54.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.GetOsdAddr (22 ms) 2024-04-25T15:23:54.821 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.OpenNoClose 2024-04-25T15:23:54.864 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.OpenNoClose (43 ms) 2024-04-25T15:23:54.864 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Nlink 2024-04-25T15:23:54.930 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Nlink (67 ms) 2024-04-25T15:23:54.931 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SlashDotDot 2024-04-25T15:23:55.987 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SlashDotDot (1056 ms) 2024-04-25T15:23:55.988 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Btime 2024-04-25T15:23:57.021 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Btime (1034 ms) 2024-04-25T15:23:57.022 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SetBtime 2024-04-25T15:23:57.053 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SetBtime (32 ms) 2024-04-25T15:23:57.053 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LazyStatx 2024-04-25T15:23:58.114 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LazyStatx (1061 ms) 2024-04-25T15:23:58.114 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ChangeAttr 2024-04-25T15:23:58.154 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ChangeAttr (40 ms) 2024-04-25T15:23:58.155 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DirChangeAttrCreateFile 2024-04-25T15:23:58.230 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DirChangeAttrCreateFile (75 ms) 2024-04-25T15:23:58.231 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DirChangeAttrRenameFile 2024-04-25T15:23:58.311 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DirChangeAttrRenameFile (76 ms) 2024-04-25T15:23:58.311 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.DirChangeAttrRemoveFile 2024-04-25T15:23:58.383 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.DirChangeAttrRemoveFile (77 ms) 2024-04-25T15:23:58.383 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SetSize 2024-04-25T15:23:58.419 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SetSize (36 ms) 2024-04-25T15:23:58.419 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.OperationsOnRoot 2024-04-25T15:23:58.444 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.OperationsOnRoot (25 ms) 2024-04-25T15:23:58.444 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ShutdownRace 2024-04-25T15:23:58.444 INFO:tasks.workunit.client.0.smithi033.stdout:Setting RLIMIT_NOFILE from 1024 to 16384 2024-04-25T15:24:08.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:24:08.213 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:24:26.071 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ShutdownRace (27626 ms) 2024-04-25T15:24:26.071 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.TestUtime 2024-04-25T15:24:26.105 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.TestUtime (35 ms) 2024-04-25T15:24:26.105 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.TestUtimes 2024-04-25T15:24:26.146 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.TestUtimes (41 ms) 2024-04-25T15:24:26.146 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.TestFutimens 2024-04-25T15:24:26.178 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.TestFutimens (32 ms) 2024-04-25T15:24:26.178 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.OperationsOnDotDot 2024-04-25T15:24:26.216 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.OperationsOnDotDot (38 ms) 2024-04-25T15:24:26.216 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Caps_vxattr 2024-04-25T15:24:26.244 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Caps_vxattr (28 ms) 2024-04-25T15:24:26.245 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapXattrs 2024-04-25T15:24:27.266 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapXattrs (1022 ms) 2024-04-25T15:24:27.266 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Lseek 2024-04-25T15:24:27.303 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Lseek (38 ms) 2024-04-25T15:24:27.304 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapInfoOnNonSnapshot 2024-04-25T15:24:28.327 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapInfoOnNonSnapshot (1023 ms) 2024-04-25T15:24:28.327 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.EmptySnapInfo 2024-04-25T15:24:29.351 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.EmptySnapInfo (1024 ms) 2024-04-25T15:24:29.351 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapInfo 2024-04-25T15:24:30.375 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapInfo (1024 ms) 2024-04-25T15:24:30.375 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LookupInoMDSDir 2024-04-25T15:24:30.402 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LookupInoMDSDir (27 ms) 2024-04-25T15:24:30.402 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LookupVino 2024-04-25T15:24:32.489 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LookupVino (2087 ms) 2024-04-25T15:24:32.489 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Openat 2024-04-25T15:24:32.570 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Openat (78 ms) 2024-04-25T15:24:32.570 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Statxat 2024-04-25T15:24:32.649 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Statxat (82 ms) 2024-04-25T15:24:32.650 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.StatxatATFDCWD 2024-04-25T15:24:32.721 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.StatxatATFDCWD (72 ms) 2024-04-25T15:24:32.721 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Fdopendir 2024-04-25T15:24:32.809 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Fdopendir (85 ms) 2024-04-25T15:24:32.809 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.FdopendirATFDCWD 2024-04-25T15:24:32.879 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.FdopendirATFDCWD (72 ms) 2024-04-25T15:24:32.879 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.FdopendirReaddirTestWithDelete 2024-04-25T15:24:32.952 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.FdopendirReaddirTestWithDelete (73 ms) 2024-04-25T15:24:32.952 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.FdopendirOnNonDir 2024-04-25T15:24:33.036 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.FdopendirOnNonDir (83 ms) 2024-04-25T15:24:33.036 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Mkdirat 2024-04-25T15:24:33.088 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Mkdirat (53 ms) 2024-04-25T15:24:33.088 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.MkdiratATFDCWD 2024-04-25T15:24:33.129 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.MkdiratATFDCWD (41 ms) 2024-04-25T15:24:33.129 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Readlinkat 2024-04-25T15:24:33.214 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Readlinkat (80 ms) 2024-04-25T15:24:33.214 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ReadlinkatATFDCWD 2024-04-25T15:24:33.283 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ReadlinkatATFDCWD (73 ms) 2024-04-25T15:24:33.283 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Symlinkat 2024-04-25T15:24:33.367 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Symlinkat (84 ms) 2024-04-25T15:24:33.368 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SymlinkatATFDCWD 2024-04-25T15:24:33.552 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SymlinkatATFDCWD (182 ms) 2024-04-25T15:24:33.552 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Unlinkat 2024-04-25T15:24:33.644 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Unlinkat (93 ms) 2024-04-25T15:24:33.644 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.UnlinkatATFDCWD 2024-04-25T15:24:33.720 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.UnlinkatATFDCWD (77 ms) 2024-04-25T15:24:33.720 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Chownat 2024-04-25T15:24:33.802 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Chownat (78 ms) 2024-04-25T15:24:33.802 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ChownatATFDCWD 2024-04-25T15:24:33.879 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ChownatATFDCWD (78 ms) 2024-04-25T15:24:33.879 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Chmodat 2024-04-25T15:24:33.959 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Chmodat (80 ms) 2024-04-25T15:24:33.960 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ChmodatATFDCWD 2024-04-25T15:24:34.048 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ChmodatATFDCWD (87 ms) 2024-04-25T15:24:34.048 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.Utimensat 2024-04-25T15:24:35.399 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.Utimensat (1354 ms) 2024-04-25T15:24:35.399 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.UtimensatATFDCWD 2024-04-25T15:24:38.274 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:24:38.277 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:24:40.406 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.UtimensatATFDCWD (5007 ms) 2024-04-25T15:24:40.406 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LookupMdsPrivateInos 2024-04-25T15:24:40.663 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LookupMdsPrivateInos (257 ms) 2024-04-25T15:24:40.663 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SetMountTimeoutPostMount 2024-04-25T15:24:40.686 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SetMountTimeoutPostMount (24 ms) 2024-04-25T15:24:40.687 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SetMountTimeout 2024-04-25T15:24:40.710 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SetMountTimeout (23 ms) 2024-04-25T15:24:40.710 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.FsCrypt 2024-04-25T15:24:41.752 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.FsCrypt (1042 ms) 2024-04-25T15:24:41.752 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapdirAttrs 2024-04-25T15:24:42.781 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapdirAttrs (1029 ms) 2024-04-25T15:24:42.781 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapCreate 2024-04-25T15:24:43.808 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapCreate (1027 ms) 2024-04-25T15:24:43.808 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapDelete 2024-04-25T15:24:44.832 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapDelete (1024 ms) 2024-04-25T15:24:44.833 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapdirAttrsOnSnapRename 2024-04-25T15:24:45.857 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapdirAttrsOnSnapRename (1025 ms) 2024-04-25T15:24:45.858 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 117 tests from LibCephFS (137881 ms total) 2024-04-25T15:24:45.858 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:45.858 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 3 tests from MonConfig 2024-04-25T15:24:45.858 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] MonConfig.MonAddrsMissing 2024-04-25T15:24:45.868 INFO:tasks.workunit.client.0.smithi033.stderr:failed to get an address for mon.a: error -2 2024-04-25T15:24:45.869 INFO:tasks.workunit.client.0.smithi033.stderr:failed to get an address for mon.b: error -2 2024-04-25T15:24:45.869 INFO:tasks.workunit.client.0.smithi033.stderr:failed to get an address for mon.c: error -2 2024-04-25T15:24:45.991 INFO:tasks.workunit.client.0.smithi033.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-04-25T15:24:45.991 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] MonConfig.MonAddrsMissing (134 ms) 2024-04-25T15:24:45.991 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] MonConfig.MonAddrsInConfigProxy 2024-04-25T15:24:46.022 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] MonConfig.MonAddrsInConfigProxy (31 ms) 2024-04-25T15:24:46.022 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] MonConfig.MonAddrsInCct 2024-04-25T15:24:47.061 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] MonConfig.MonAddrsInCct (1039 ms) 2024-04-25T15:24:47.062 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 3 tests from MonConfig (1204 ms total) 2024-04-25T15:24:47.062 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:47.062 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 5 tests from ACL 2024-04-25T15:24:47.062 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ACL.SetACL 2024-04-25T15:24:47.097 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ACL.SetACL (37 ms) 2024-04-25T15:24:47.098 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ACL.Chmod 2024-04-25T15:24:47.133 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ACL.Chmod (35 ms) 2024-04-25T15:24:47.133 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ACL.DefaultACL 2024-04-25T15:24:47.210 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ACL.DefaultACL (75 ms) 2024-04-25T15:24:47.210 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ACL.Disabled 2024-04-25T15:24:47.245 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ACL.Disabled (38 ms) 2024-04-25T15:24:47.246 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] ACL.SnapdirACL 2024-04-25T15:24:48.265 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] ACL.SnapdirACL (1019 ms) 2024-04-25T15:24:48.265 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 5 tests from ACL (1204 ms total) 2024-04-25T15:24:48.266 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:48.266 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from Caps 2024-04-25T15:24:48.266 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] Caps.ReadZero 2024-04-25T15:24:48.485 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] Caps.ReadZero (219 ms) 2024-04-25T15:24:48.485 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from Caps (219 ms total) 2024-04-25T15:24:48.485 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:48.485 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-04-25T15:24:48.485 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 126 tests from 4 test suites ran. (140508 ms total) 2024-04-25T15:24:48.485 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 126 tests. 2024-04-25T15:24:48.486 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:48.486 INFO:tasks.workunit.client.0.smithi033.stdout: YOU HAVE 4 DISABLED TESTS 2024-04-25T15:24:48.486 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:48.560 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-25T15:24:48.560 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-04-25T15:24:48.560 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 4 tests from AccessTest 2024-04-25T15:24:48.560 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] AccessTest.Foo 2024-04-25T15:24:48.585 INFO:tasks.workunit.client.0.smithi033.stdout:out: [{"entity":"client.libcephfs_foo_test.565092874","key":"AQDAdSpmt1rIIhAAi56JbQJ3bgfXm2XkCV5D8A==","caps":{"mds":"allow rw","mon":"allow *","osd":"allow rw"}}] 2024-04-25T15:24:48.585 INFO:tasks.workunit.client.0.smithi033.stdout:key: AQDAdSpmt1rIIhAAi56JbQJ3bgfXm2XkCV5D8A== 2024-04-25T15:24:48.614 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] AccessTest.Foo (55 ms) 2024-04-25T15:24:48.615 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] AccessTest.Path 2024-04-25T15:24:48.653 INFO:tasks.workunit.client.0.smithi033.stdout:out: [{"entity":"client.libcephfs_path_test.547252180","key":"AQDAdSpmZaewJhAARLAjLZ1H+nlsDzwZEjKDUA==","caps":{"mds":"allow r, allow rw path=/ceph_test_libcephfs_access.good.637769832, allow rw path=/ceph_test_libcephfs_access.good_slash.1115475404/","mon":"allow r","osd":"allow rwx"}}] 2024-04-25T15:24:48.653 INFO:tasks.workunit.client.0.smithi033.stdout:key: AQDAdSpmZaewJhAARLAjLZ1H+nlsDzwZEjKDUA== 2024-04-25T15:24:50.778 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] AccessTest.Path (2161 ms) 2024-04-25T15:24:50.778 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] AccessTest.ReadOnly 2024-04-25T15:24:50.819 INFO:tasks.workunit.client.0.smithi033.stdout:out: [{"entity":"client.libcephfs_readonly_test.1809665933","key":"AQDCdSpmwtm+MBAAH279kex32fqHA6usUhZ/uw==","caps":{"mds":"allow r","mon":"allow r","osd":"allow rw"}}] 2024-04-25T15:24:50.819 INFO:tasks.workunit.client.0.smithi033.stdout:key: AQDCdSpmwtm+MBAAH279kex32fqHA6usUhZ/uw== 2024-04-25T15:24:50.900 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] AccessTest.ReadOnly (120 ms) 2024-04-25T15:24:50.901 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] AccessTest.User 2024-04-25T15:24:50.927 INFO:tasks.workunit.client.0.smithi033.stdout:out: [{"entity":"client.libcephfs_user_test.536312463","key":"AQDCdSpmYd8wNxAA3ekIEjQj/qlKH1GjdikFmw==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}] 2024-04-25T15:24:50.927 INFO:tasks.workunit.client.0.smithi033.stdout:key: AQDCdSpmYd8wNxAA3ekIEjQj/qlKH1GjdikFmw== 2024-04-25T15:24:51.044 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] AccessTest.User (148 ms) 2024-04-25T15:24:51.045 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 4 tests from AccessTest (2484 ms total) 2024-04-25T15:24:51.045 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:51.045 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-04-25T15:24:51.045 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 4 tests from 1 test suite ran. (2484 ms total) 2024-04-25T15:24:51.045 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 4 tests. 2024-04-25T15:24:51.093 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 1 test from 1 test suite. 2024-04-25T15:24:51.093 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-04-25T15:24:51.093 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from LibCephFS 2024-04-25T15:24:51.093 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ReclaimReset 2024-04-25T15:24:52.947 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ReclaimReset (1854 ms) 2024-04-25T15:24:52.947 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from LibCephFS (1854 ms total) 2024-04-25T15:24:52.947 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:52.947 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-04-25T15:24:52.948 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 1 test from 1 test suite ran. (1854 ms total) 2024-04-25T15:24:52.948 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 1 test. 2024-04-25T15:24:53.023 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 5 tests from 1 test suite. 2024-04-25T15:24:53.023 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-04-25T15:24:53.023 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 5 tests from LibCephFS 2024-04-25T15:24:53.023 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LazyIOOneWriterMulipleReaders 2024-04-25T15:24:53.090 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LazyIOOneWriterMulipleReaders (67 ms) 2024-04-25T15:24:53.090 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LazyIOMultipleWritersMulipleReaders 2024-04-25T15:24:53.159 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LazyIOMultipleWritersMulipleReaders (69 ms) 2024-04-25T15:24:53.159 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LazyIOMultipleWritersOneReader 2024-04-25T15:24:53.226 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LazyIOMultipleWritersOneReader (67 ms) 2024-04-25T15:24:53.226 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.LazyIOSynchronizeFlush 2024-04-25T15:24:53.295 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.LazyIOSynchronizeFlush (69 ms) 2024-04-25T15:24:53.295 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.WithoutandWithLazyIO 2024-04-25T15:24:53.367 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.WithoutandWithLazyIO (72 ms) 2024-04-25T15:24:53.368 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 5 tests from LibCephFS (344 ms total) 2024-04-25T15:24:53.368 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:53.368 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-04-25T15:24:53.368 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 5 tests from 1 test suite ran. (344 ms total) 2024-04-25T15:24:53.368 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 5 tests. 2024-04-25T15:24:53.416 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 1 test from 1 test suite. 2024-04-25T15:24:53.416 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-04-25T15:24:53.416 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from LibCephFS 2024-04-25T15:24:53.416 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.NewOPs 2024-04-25T15:24:53.448 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.NewOPs (32 ms) 2024-04-25T15:24:53.448 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from LibCephFS (32 ms total) 2024-04-25T15:24:53.448 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:53.448 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-04-25T15:24:53.449 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 1 test from 1 test suite ran. (32 ms total) 2024-04-25T15:24:53.449 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 1 test. 2024-04-25T15:24:53.517 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 2 tests from 2 test suites. 2024-04-25T15:24:53.517 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-04-25T15:24:53.517 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from SuidsgidTest 2024-04-25T15:24:53.517 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] SuidsgidTest.WriteClearSetuid 2024-04-25T15:24:53.544 INFO:tasks.workunit.client.0.smithi033.stdout:out: [{"entity":"client.clear_suidsgid_1587738120","key":"AQDFdSpmxZA6IBAAf9PyQZTxhn9mPwIkjA5xWg==","caps":{"mds":"allow *","mgr":"allow *","mon":"allow *","osd":"allow *"}}] 2024-04-25T15:24:53.544 INFO:tasks.workunit.client.0.smithi033.stdout:key: AQDFdSpmxZA6IBAAf9PyQZTxhn9mPwIkjA5xWg== 2024-04-25T15:24:53.572 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 06666 -> 0666 2024-04-25T15:24:53.580 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 06676 -> 0676 2024-04-25T15:24:53.589 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 06766 -> 0766 2024-04-25T15:24:53.598 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 06777 -> 0777 2024-04-25T15:24:53.608 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 06666 -> 06666 2024-04-25T15:24:53.610 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 06676 -> 06676 2024-04-25T15:24:53.612 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 06766 -> 06766 2024-04-25T15:24:53.614 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 06777 -> 06777 2024-04-25T15:24:53.621 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 02676 -> 0676 2024-04-25T15:24:53.630 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_fallocate, mode: 02777 -> 0777 2024-04-25T15:24:53.639 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_write, mode: 06766 -> 06766 2024-04-25T15:24:53.646 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_write, mode: 06766 -> 0766 2024-04-25T15:24:53.657 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_truncate size 10000 mode: 06766 -> 06766 2024-04-25T15:24:53.667 INFO:tasks.workunit.client.0.smithi033.stdout:After ceph_truncate size 100 mode: 06766 -> 0766 2024-04-25T15:24:53.675 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] SuidsgidTest.WriteClearSetuid (158 ms) 2024-04-25T15:24:53.675 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from SuidsgidTest (158 ms total) 2024-04-25T15:24:53.675 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:53.675 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from LibCephFS 2024-04-25T15:24:53.675 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.ChownClearSetuid 2024-04-25T15:24:53.703 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.ChownClearSetuid (28 ms) 2024-04-25T15:24:53.703 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 1 test from LibCephFS (28 ms total) 2024-04-25T15:24:53.703 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:24:53.703 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-04-25T15:24:53.704 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 2 tests from 2 test suites ran. (186 ms total) 2024-04-25T15:24:53.704 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 2 tests. 2024-04-25T15:24:53.752 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 7 tests from 1 test suite. 2024-04-25T15:24:53.752 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2024-04-25T15:24:53.752 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 7 tests from LibCephFS 2024-04-25T15:24:53.752 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapDiffLib 2024-04-25T15:24:53.841 INFO:tasks.workunit.client.0.smithi033.stdout:16 vs. 17 2024-04-25T15:24:53.841 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 listing verification--------- 2024-04-25T15:24:55.381 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 listing verification--------- 2024-04-25T15:25:00.381 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing for / 2024-04-25T15:25:00.385 INFO:tasks.workunit.client.0.smithi033.stdout:dirB snap 17 2024-04-25T15:25:00.386 INFO:tasks.workunit.client.0.smithi033.stdout:fileB snap 17 2024-04-25T15:25:00.386 INFO:tasks.workunit.client.0.smithi033.stdout:fileC snap 16 2024-04-25T15:25:00.386 INFO:tasks.workunit.client.0.smithi033.stdout:fileA snap 17 2024-04-25T15:25:00.386 INFO:tasks.workunit.client.0.smithi033.stdout:dirC snap 16 2024-04-25T15:25:00.386 INFO:tasks.workunit.client.0.smithi033.stdout:dirD snap 17 2024-04-25T15:25:00.387 INFO:tasks.workunit.client.0.smithi033.stdout:dirA snap 17 2024-04-25T15:25:00.387 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-04-25T15:25:00.395 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2024-04-25T15:25:00.398 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2024-04-25T15:25:00.403 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap1 diff listing verification for /dirC 2024-04-25T15:25:01.408 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2024-04-25T15:25:02.412 INFO:tasks.workunit.client.0.smithi033.stdout:---------invalid snapdiff params, the same snaps--------- 2024-04-25T15:25:02.414 INFO:tasks.workunit.client.0.smithi033.stderr: Failed to readdir snapdiff, ret:-22 , snap2 vs. snap2 2024-04-25T15:25:02.414 INFO:tasks.workunit.client.0.smithi033.stderr: Failed to open snapdiff, ret:-22 2024-04-25T15:25:02.414 INFO:tasks.workunit.client.0.smithi033.stdout:---------invalid snapdiff params, no snap_other --------- 2024-04-25T15:25:02.424 INFO:tasks.workunit.client.0.smithi033.stdout:------------- closing ------------- 2024-04-25T15:25:02.811 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapDiffLib (9059 ms) 2024-04-25T15:25:02.812 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapDiffLib2 2024-04-25T15:25:02.980 INFO:tasks.workunit.client.0.smithi033.stdout:20 vs. 21 vs. 22 2024-04-25T15:25:02.980 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 listing verification--------- 2024-04-25T15:25:05.380 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 listing verification--------- 2024-04-25T15:25:08.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:25:08.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:25:10.382 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 listing verification--------- 2024-04-25T15:25:10.389 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 listing verification--------- 2024-04-25T15:25:10.394 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 listing verification--------- 2024-04-25T15:25:10.399 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 listing verification--------- 2024-04-25T15:25:10.402 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing for / 2024-04-25T15:25:10.406 INFO:tasks.workunit.client.0.smithi033.stdout:fileG snap 21 2024-04-25T15:25:10.407 INFO:tasks.workunit.client.0.smithi033.stdout:dirB snap 21 2024-04-25T15:25:10.407 INFO:tasks.workunit.client.0.smithi033.stdout:fileB snap 21 2024-04-25T15:25:10.407 INFO:tasks.workunit.client.0.smithi033.stdout:fileC snap 20 2024-04-25T15:25:10.407 INFO:tasks.workunit.client.0.smithi033.stdout:fileA snap 21 2024-04-25T15:25:10.407 INFO:tasks.workunit.client.0.smithi033.stdout:dirC snap 20 2024-04-25T15:25:10.408 INFO:tasks.workunit.client.0.smithi033.stdout:dirD snap 21 2024-04-25T15:25:10.408 INFO:tasks.workunit.client.0.smithi033.stdout:fileF snap 20 2024-04-25T15:25:10.408 INFO:tasks.workunit.client.0.smithi033.stdout:dirA snap 21 2024-04-25T15:25:10.408 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-04-25T15:25:10.413 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 listing verification--------- 2024-04-25T15:25:10.418 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 listing verification--------- 2024-04-25T15:25:10.422 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 listing verification--------- 2024-04-25T15:25:10.425 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap1 diff listing verification for / 2024-04-25T15:25:10.430 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 listing verification--------- 2024-04-25T15:25:10.434 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 listing verification--------- 2024-04-25T15:25:10.438 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 listing verification--------- 2024-04-25T15:25:10.441 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for / 2024-04-25T15:25:10.445 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for / 2024-04-25T15:25:10.450 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 listing verification--------- 2024-04-25T15:25:10.454 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 listing verification--------- 2024-04-25T15:25:10.458 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 listing verification--------- 2024-04-25T15:25:10.460 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing for /dirA 2024-04-25T15:25:10.463 INFO:tasks.workunit.client.0.smithi033.stdout:fileA snap 21 2024-04-25T15:25:10.463 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /dirA 2024-04-25T15:25:10.466 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing for /dirB 2024-04-25T15:25:10.470 INFO:tasks.workunit.client.0.smithi033.stdout:fileb snap 21 2024-04-25T15:25:10.470 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /dirB 2024-04-25T15:25:10.473 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing for /dirD 2024-04-25T15:25:10.476 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /dirD 2024-04-25T15:25:10.479 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 listing verification--------- 2024-04-25T15:25:10.483 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 listing verification--------- 2024-04-25T15:25:10.486 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 listing verification--------- 2024-04-25T15:25:10.489 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-04-25T15:25:10.494 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap2 diff listing verification for / 2024-04-25T15:25:10.498 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for / 2024-04-25T15:25:10.503 INFO:tasks.workunit.client.0.smithi033.stdout:------------- closing ------------- 2024-04-25T15:25:10.874 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapDiffLib2 (8060 ms) 2024-04-25T15:25:10.874 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapDiffCases1_2 2024-04-25T15:25:11.244 INFO:tasks.workunit.client.0.smithi033.stdout:26 vs. 27 2024-04-25T15:25:11.245 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing for / 2024-04-25T15:25:11.248 INFO:tasks.workunit.client.0.smithi033.stdout:C snap 26 2024-04-25T15:25:11.248 INFO:tasks.workunit.client.0.smithi033.stdout:L snap 27 2024-04-25T15:25:11.248 INFO:tasks.workunit.client.0.smithi033.stdout:S snap 27 2024-04-25T15:25:11.250 INFO:tasks.workunit.client.0.smithi033.stdout:T snap 27 2024-04-25T15:25:11.250 INFO:tasks.workunit.client.0.smithi033.stdout:d snap 27 2024-04-25T15:25:11.250 INFO:tasks.workunit.client.0.smithi033.stdout:G snap 26 2024-04-25T15:25:11.250 INFO:tasks.workunit.client.0.smithi033.stdout:l snap 27 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:e snap 27 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:~e snap 27 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:g snap 26 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:c snap 26 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:b snap 27 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:f snap 27 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:I snap 27 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:K snap 27 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:k snap 27 2024-04-25T15:25:11.251 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-04-25T15:25:11.255 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /S 2024-04-25T15:25:11.258 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /T 2024-04-25T15:25:11.261 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap1 diff listing verification for /C 2024-04-25T15:25:11.266 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap1 diff listing verification for /C/CC 2024-04-25T15:25:11.270 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /I 2024-04-25T15:25:11.274 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /I/J 2024-04-25T15:25:11.278 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /L 2024-04-25T15:25:11.284 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /L/LL 2024-04-25T15:25:11.288 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /L/LN 2024-04-25T15:25:11.292 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for /L/LM 2024-04-25T15:25:11.296 INFO:tasks.workunit.client.0.smithi033.stdout:------------- 2024-04-25T15:25:11.932 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapDiffCases1_2 (1056 ms) 2024-04-25T15:25:11.932 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapDiffCases2_3 2024-04-25T15:25:12.323 INFO:tasks.workunit.client.0.smithi033.stdout:33 vs. 34 2024-04-25T15:25:12.323 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing for / 2024-04-25T15:25:12.328 INFO:tasks.workunit.client.0.smithi033.stdout:H snap 34 2024-04-25T15:25:12.329 INFO:tasks.workunit.client.0.smithi033.stdout:L snap 34 2024-04-25T15:25:12.329 INFO:tasks.workunit.client.0.smithi033.stdout:S snap 34 2024-04-25T15:25:12.329 INFO:tasks.workunit.client.0.smithi033.stdout:ff snap 33 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:T snap 34 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:d snap 34 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:G snap 34 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:e snap 33 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:~e snap 33 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:g snap 34 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:b snap 34 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:f snap 33 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:I snap 34 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:a snap 34 2024-04-25T15:25:12.331 INFO:tasks.workunit.client.0.smithi033.stdout:K snap 33 2024-04-25T15:25:12.332 INFO:tasks.workunit.client.0.smithi033.stdout:k snap 33 2024-04-25T15:25:12.332 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for / 2024-04-25T15:25:12.336 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /S 2024-04-25T15:25:12.340 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /T 2024-04-25T15:25:12.343 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /G 2024-04-25T15:25:12.347 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap2 diff listing verification for /K 2024-04-25T15:25:12.352 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /H 2024-04-25T15:25:12.357 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /I 2024-04-25T15:25:12.363 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /I/J 2024-04-25T15:25:12.368 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /L 2024-04-25T15:25:12.375 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /L/LL 2024-04-25T15:25:12.378 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap2 diff listing verification for /L/LM 2024-04-25T15:25:12.383 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap2 vs. snap3 diff listing verification for /L/LN 2024-04-25T15:25:12.989 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapDiffCases2_3 (1056 ms) 2024-04-25T15:25:12.989 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.SnapDiffCases1_3 2024-04-25T15:25:13.419 INFO:tasks.workunit.client.0.smithi033.stdout:38 vs. 40 2024-04-25T15:25:13.419 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing for / 2024-04-25T15:25:13.423 INFO:tasks.workunit.client.0.smithi033.stdout:C snap 38 2024-04-25T15:25:13.423 INFO:tasks.workunit.client.0.smithi033.stdout:H snap 40 2024-04-25T15:25:13.424 INFO:tasks.workunit.client.0.smithi033.stdout:L snap 40 2024-04-25T15:25:13.424 INFO:tasks.workunit.client.0.smithi033.stdout:S snap 40 2024-04-25T15:25:13.424 INFO:tasks.workunit.client.0.smithi033.stdout:ff snap 38 2024-04-25T15:25:13.425 INFO:tasks.workunit.client.0.smithi033.stdout:T snap 40 2024-04-25T15:25:13.425 INFO:tasks.workunit.client.0.smithi033.stdout:d snap 40 2024-04-25T15:25:13.425 INFO:tasks.workunit.client.0.smithi033.stdout:G snap 38 2024-04-25T15:25:13.426 INFO:tasks.workunit.client.0.smithi033.stdout:G snap 40 2024-04-25T15:25:13.426 INFO:tasks.workunit.client.0.smithi033.stdout:l snap 40 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:e snap 38 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:~e snap 38 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:g snap 40 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:c snap 38 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:b snap 40 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:f snap 38 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:I snap 40 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:a snap 40 2024-04-25T15:25:13.427 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap1 diff listing verification for / 2024-04-25T15:25:13.432 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap1 diff listing verification for /S 2024-04-25T15:25:13.435 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap1 diff listing verification for /T 2024-04-25T15:25:13.439 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap1 diff listing verification for /C 2024-04-25T15:25:13.443 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap1 diff listing verification for /C/CC 2024-04-25T15:25:13.447 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for /G 2024-04-25T15:25:13.450 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap3 vs. snap1 diff listing verification for /G 2024-04-25T15:25:13.453 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for /H 2024-04-25T15:25:13.457 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for /I 2024-04-25T15:25:13.461 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for /I/J 2024-04-25T15:25:13.465 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for /L 2024-04-25T15:25:13.471 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for /L/LL 2024-04-25T15:25:13.475 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap3 diff listing verification for /L/LN 2024-04-25T15:25:13.479 INFO:tasks.workunit.client.0.smithi033.stdout:------------- 2024-04-25T15:25:14.047 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.SnapDiffCases1_3 (1062 ms) 2024-04-25T15:25:14.047 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.HugeSnapDiffSmallDelta 2024-04-25T15:25:38.477 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:25:38.481 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:26:01.962 INFO:tasks.workunit.client.0.smithi033.stdout:Seeding 10000 files... 2024-04-25T15:26:01.962 INFO:tasks.workunit.client.0.smithi033.stdout:44 vs. 45 2024-04-25T15:26:01.962 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-04-25T15:26:02.358 INFO:tasks.workunit.client.0.smithi033.stdout:------------- closing ------------- 2024-04-25T15:26:08.602 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:26:08.605 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:26:38.715 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.HugeSnapDiffSmallDelta (84669 ms) 2024-04-25T15:26:38.716 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] LibCephFS.HugeSnapDiffLargeDelta 2024-04-25T15:26:39.004 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:26:39.007 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:27:09.285 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:27:09.288 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:27:39.352 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:27:39.355 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:28:09.440 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:28:09.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:28:39.571 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:28:39.574 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:29:09.639 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:29:09.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T15:29:10.042 INFO:tasks.ceph.mds.a.smithi033.stderr:2024-04-25T15:29:10.041+0000 7fd95ea04640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 63816) UID: 0 2024-04-25T15:29:34.570 INFO:tasks.workunit.client.0.smithi033.stdout:Seeding 15100 files... 2024-04-25T15:29:34.571 INFO:tasks.workunit.client.0.smithi033.stdout:48 vs. 49 2024-04-25T15:29:34.573 INFO:tasks.workunit.client.0.smithi033.stdout:---------snap1 vs. snap2 diff listing verification for / 2024-04-25T15:29:36.611 INFO:tasks.workunit.client.0.smithi033.stdout:------------- closing ------------- 2024-04-25T15:30:36.694 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] LibCephFS.HugeSnapDiffLargeDelta (237979 ms) 2024-04-25T15:30:36.694 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 7 tests from LibCephFS (342941 ms total) 2024-04-25T15:30:36.694 INFO:tasks.workunit.client.0.smithi033.stdout: 2024-04-25T15:30:36.695 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment tear-down 2024-04-25T15:30:36.695 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] 7 tests from 1 test suite ran. (342941 ms total) 2024-04-25T15:30:36.695 INFO:tasks.workunit.client.0.smithi033.stdout:[ PASSED ] 7 tests. 2024-04-25T15:30:36.698 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T15:30:36.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T15:30:36.743 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0... 2024-04-25T15:30:36.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T15:30:37.247 DEBUG:teuthology.parallel:result is None 2024-04-25T15:30:37.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T15:30:37.286 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T15:30:37.286 DEBUG:teuthology.orchestra.run.smithi033:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-25T15:30:37.354 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T15:30:37.355 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-25T15:30:37.365 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:30:37.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.580+0000 7fc1e4abd640 1 Processor -- start 2024-04-25T15:30:37.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.580+0000 7fc1e4abd640 1 -- start start 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.582+0000 7fc1e4abd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc1e006f870 0x7fc1e009f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.582+0000 7fc1e4abd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc1e0145f70 0x7fc1e009f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.582+0000 7fc1e4abd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e00afb80 con 0x7fc1e00af660 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.582+0000 7fc1e4abd640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e00afe60 con 0x7fc1e0145f70 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.582+0000 7fc1e4abd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e00b6da0 con 0x7fc1e006f870 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.583+0000 7fc1deffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc1e00af660 0x7fc1e0145860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:45428/0 (socket says 172.21.15.33:45428) 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.583+0000 7fc1deffd640 1 -- 172.21.15.33:0/712807369 learned_addr learned my addr 172.21.15.33:0/712807369 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.583+0000 7fc1dffff640 1 --2- 172.21.15.33:0/712807369 >> v2:172.21.15.33:3300/0 conn(0x7fc1e0145f70 0x7fc1e009f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.583+0000 7fc1df7fe640 1 --2- 172.21.15.33:0/712807369 >> v2:172.21.15.155:3300/0 conn(0x7fc1e006f870 0x7fc1e009f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:37.586 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.583+0000 7fc1dffff640 1 -- 172.21.15.33:0/712807369 >> v2:172.21.15.155:3300/0 conn(0x7fc1e006f870 msgr2=0x7fc1e009f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.583+0000 7fc1dffff640 1 --2- 172.21.15.33:0/712807369 >> v2:172.21.15.155:3300/0 conn(0x7fc1e006f870 0x7fc1e009f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.583+0000 7fc1dffff640 1 -- 172.21.15.33:0/712807369 >> v1:172.21.15.155:6789/0 conn(0x7fc1e00af660 legacy=0x7fc1e0145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.583+0000 7fc1dffff640 1 -- 172.21.15.33:0/712807369 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e00b0890 con 0x7fc1e0145f70 2024-04-25T15:30:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.584+0000 7fc1dffff640 1 --2- 172.21.15.33:0/712807369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e009f860 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00700d0 tx=0x7fc1d003b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1d5b20a61f9fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:37.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.585+0000 7fc1de7fc640 1 -- 172.21.15.33:0/712807369 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0048070 con 0x7fc1e0145f70 2024-04-25T15:30:37.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.585+0000 7fc1de7fc640 1 -- 172.21.15.33:0/712807369 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0043440 con 0x7fc1e0145f70 2024-04-25T15:30:37.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.585+0000 7fc1de7fc640 1 -- 172.21.15.33:0/712807369 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00437f0 con 0x7fc1e0145f70 2024-04-25T15:30:37.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.586+0000 7fc1e4abd640 1 -- 172.21.15.33:0/712807369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 msgr2=0x7fc1e009f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:37.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.586+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/712807369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e009f860 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00700d0 tx=0x7fc1d003b1d0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.595+0000 7fc1e4abd640 1 -- 172.21.15.33:0/712807369 shutdown_connections 2024-04-25T15:30:37.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.595+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/712807369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e009f860 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.595+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/712807369 >> v2:172.21.15.155:3300/0 conn(0x7fc1e006f870 0x7fc1e009f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.595+0000 7fc1e4abd640 1 -- 172.21.15.33:0/712807369 >> 172.21.15.33:0/712807369 conn(0x7fc1e00ba640 msgr2=0x7fc1e00baa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:37.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.596+0000 7fc1e4abd640 1 -- 172.21.15.33:0/712807369 shutdown_connections 2024-04-25T15:30:37.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.598+0000 7fc1e4abd640 1 -- 172.21.15.33:0/712807369 wait complete. 2024-04-25T15:30:37.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.601+0000 7fc1e4abd640 1 Processor -- start 2024-04-25T15:30:37.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.601+0000 7fc1e4abd640 1 -- start start 2024-04-25T15:30:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.602+0000 7fc1e4abd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e006f870 0x7fc1e01dbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1e4abd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e00af660 0x7fc1e01424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1e4abd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e013f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1e4abd640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e00b0eb0 con 0x7fc1e0145f70 2024-04-25T15:30:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1e4abd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e00b0d30 con 0x7fc1e006f870 2024-04-25T15:30:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1e4abd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e00b1030 con 0x7fc1e00af660 2024-04-25T15:30:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1deffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e00af660 0x7fc1e01424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1df7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e006f870 0x7fc1e01dbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1dffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e013f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1df7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e006f870 0x7fc1e01dbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:56548/0 (socket says 172.21.15.33:56548) 2024-04-25T15:30:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1df7fe640 1 -- 172.21.15.33:0/3016313433 learned_addr learned my addr 172.21.15.33:0/3016313433 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.603+0000 7fc1dffff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e013f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45316/0 (socket says 172.21.15.33:45316) 2024-04-25T15:30:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.604+0000 7fc1dffff640 1 -- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e00af660 msgr2=0x7fc1e01424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.604+0000 7fc1dffff640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e00af660 0x7fc1e01424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.604+0000 7fc1dffff640 1 -- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e006f870 msgr2=0x7fc1e01dbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.604+0000 7fc1dffff640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e006f870 0x7fc1e01dbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.604+0000 7fc1dffff640 1 -- 172.21.15.33:0/3016313433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e01dc080 con 0x7fc1e0145f70 2024-04-25T15:30:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.604+0000 7fc1dffff640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e013f250 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fc1e006d400 tx=0x7fc1d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.605+0000 7fc1c7fff640 1 -- 172.21.15.33:0/3016313433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0048040 con 0x7fc1e0145f70 2024-04-25T15:30:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.605+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e01db360 con 0x7fc1e0145f70 2024-04-25T15:30:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.605+0000 7fc1c7fff640 1 -- 172.21.15.33:0/3016313433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0053070 con 0x7fc1e0145f70 2024-04-25T15:30:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.605+0000 7fc1c7fff640 1 -- 172.21.15.33:0/3016313433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0006e10 con 0x7fc1e0145f70 2024-04-25T15:30:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.605+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e0074100 con 0x7fc1e0145f70 2024-04-25T15:30:37.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.606+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e0140000 con 0x7fc1e0145f70 2024-04-25T15:30:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.609+0000 7fc1c7fff640 1 -- 172.21.15.33:0/3016313433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc1d00437f0 con 0x7fc1e0145f70 2024-04-25T15:30:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.610+0000 7fc1c7fff640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc1cc0744e0 0x7fc1cc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.610+0000 7fc1c7fff640 1 -- 172.21.15.33:0/3016313433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7fc1d00c6bf0 con 0x7fc1e0145f70 2024-04-25T15:30:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.610+0000 7fc1df7fe640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc1cc0744e0 0x7fc1cc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:37.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.615+0000 7fc1df7fe640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc1cc0744e0 0x7fc1cc0769f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400ba70 tx=0x7fc1d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:37.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.618+0000 7fc1c7fff640 1 -- 172.21.15.33:0/3016313433 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc1d0091290 con 0x7fc1e0145f70 2024-04-25T15:30:37.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.981+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1e0076c00 con 0x7fc1e0145f70 2024-04-25T15:30:37.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.984+0000 7fc1c7fff640 1 -- 172.21.15.33:0/3016313433 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17014 (secure 0 0 0) 0x7fc1d0090b90 con 0x7fc1e0145f70 2024-04-25T15:30:37.986 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:30:37.986 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:30:30.582237+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":51,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1370918468":"2024-04-25T16:24:51.186771+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":48,"length":4}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":48,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.988+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc1cc0744e0 msgr2=0x7fc1cc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.988+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc1cc0744e0 0x7fc1cc0769f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400ba70 tx=0x7fc1d4008040 comp rx=0 tx=0).stop 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.988+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 msgr2=0x7fc1e013f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.988+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e013f250 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fc1e006d400 tx=0x7fc1d00046c0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.989+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 shutdown_connections 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.989+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc1cc0744e0 0x7fc1cc0769f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.989+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1e0145f70 0x7fc1e013f250 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.989+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1e00af660 0x7fc1e01424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.989+0000 7fc1e4abd640 1 --2- 172.21.15.33:0/3016313433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e006f870 0x7fc1e01dbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.989+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 >> 172.21.15.33:0/3016313433 conn(0x7fc1e00ba640 msgr2=0x7fc1e009f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.989+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 shutdown_connections 2024-04-25T15:30:37.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:37.989+0000 7fc1e4abd640 1 -- 172.21.15.33:0/3016313433 wait complete. 2024-04-25T15:30:38.009 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T15:20:29.721824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T15:20:39.967842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T15:20:40.725695+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 51, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T15:30:38.009 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T15:30:38.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.194+0000 7f96ba86e640 1 Processor -- start 2024-04-25T15:30:38.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.195+0000 7f96ba86e640 1 -- start start 2024-04-25T15:30:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.196+0000 7f96ba86e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4070550 0x7f96b40b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.196+0000 7f96ba86e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96b40b23e0 0x7f96b4147c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.196+0000 7f96ba86e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f96b4148190 0x7f96b40b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.196+0000 7f96ba86e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f96b40b8730 con 0x7f96b4148190 2024-04-25T15:30:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.196+0000 7f96ba86e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f96b40b8cf0 con 0x7f96b40b23e0 2024-04-25T15:30:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.196+0000 7f96ba86e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96b40b3270 con 0x7f96b4070550 2024-04-25T15:30:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.197+0000 7f96b8e0b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f96b4148190 0x7f96b40b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.197+0000 7f96b8e0b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f96b4148190 0x7f96b40b7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45328/0 (socket says 172.21.15.33:45328) 2024-04-25T15:30:38.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.197+0000 7f96b8e0b640 1 -- 172.21.15.33:0/3653600637 learned_addr learned my addr 172.21.15.33:0/3653600637 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:38.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.197+0000 7f96b8e0b640 1 -- 172.21.15.33:0/3653600637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4070550 msgr2=0x7f96b40b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.197+0000 7f96b8e0b640 1 --2- 172.21.15.33:0/3653600637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4070550 0x7f96b40b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.197+0000 7f96b8e0b640 1 -- 172.21.15.33:0/3653600637 >> v2:172.21.15.155:3300/0 conn(0x7f96b40b23e0 msgr2=0x7f96b4147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.197+0000 7f96b8e0b640 1 --2- 172.21.15.33:0/3653600637 >> v2:172.21.15.155:3300/0 conn(0x7f96b40b23e0 0x7f96b4147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.197+0000 7f96b8e0b640 1 -- 172.21.15.33:0/3653600637 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b40b3c50 con 0x7f96b4148190 2024-04-25T15:30:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.199+0000 7f96b8e0b640 1 --2- 172.21.15.33:0/3653600637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b4148190 0x7f96b40b7510 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f96b40ba670 tx=0x7f96ac02a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10b651cc20c784d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:38.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.200+0000 7f96b2ffd640 1 -- 172.21.15.33:0/3653600637 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac036070 con 0x7f96b4148190 2024-04-25T15:30:38.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.200+0000 7f96b2ffd640 1 -- 172.21.15.33:0/3653600637 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac031600 con 0x7f96b4148190 2024-04-25T15:30:38.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.200+0000 7f96b2ffd640 1 -- 172.21.15.33:0/3653600637 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac031a10 con 0x7f96b4148190 2024-04-25T15:30:38.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 -- 172.21.15.33:0/3653600637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b4148190 msgr2=0x7f96b40b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3653600637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b4148190 0x7f96b40b7510 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f96b40ba670 tx=0x7f96ac02a5b0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 -- 172.21.15.33:0/3653600637 shutdown_connections 2024-04-25T15:30:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3653600637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b4148190 0x7f96b40b7510 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3653600637 >> v2:172.21.15.155:3300/0 conn(0x7f96b40b23e0 0x7f96b4147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3653600637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4070550 0x7f96b40b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 -- 172.21.15.33:0/3653600637 >> 172.21.15.33:0/3653600637 conn(0x7f96b4063ad0 msgr2=0x7f96b40bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 -- 172.21.15.33:0/3653600637 shutdown_connections 2024-04-25T15:30:38.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.201+0000 7f96ba86e640 1 -- 172.21.15.33:0/3653600637 wait complete. 2024-04-25T15:30:38.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.204+0000 7f96ba86e640 1 Processor -- start 2024-04-25T15:30:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.204+0000 7f96ba86e640 1 -- start start 2024-04-25T15:30:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.205+0000 7f96ba86e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4070550 0x7f96b4153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.205+0000 7f96ba86e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b40b23e0 0x7f96b414af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.205+0000 7f96ba86e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4148190 0x7f96b41fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.206+0000 7f96ba86e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4070960 con 0x7f96b40b23e0 2024-04-25T15:30:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.206+0000 7f96ba86e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96b40b8980 con 0x7f96b4070550 2024-04-25T15:30:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.206+0000 7f96ba86e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96b4071990 con 0x7f96b4148190 2024-04-25T15:30:38.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.206+0000 7f96b8e0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4148190 0x7f96b41fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b8e0b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4148190 0x7f96b41fd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:38796/0 (socket says 172.21.15.33:38796) 2024-04-25T15:30:38.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b8e0b640 1 -- 172.21.15.33:0/3060378465 learned_addr learned my addr 172.21.15.33:0/3060378465 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b3fff640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4070550 0x7f96b4153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b37fe640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b40b23e0 0x7f96b414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b8e0b640 1 -- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4070550 msgr2=0x7f96b4153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b8e0b640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4070550 0x7f96b4153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b8e0b640 1 -- 172.21.15.33:0/3060378465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b40b23e0 msgr2=0x7f96b414af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b8e0b640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b40b23e0 0x7f96b414af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.207+0000 7f96b8e0b640 1 -- 172.21.15.33:0/3060378465 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b41427a0 con 0x7f96b4148190 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.208+0000 7f96b37fe640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b40b23e0 0x7f96b414af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:30:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.208+0000 7f96b8e0b640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4148190 0x7f96b41fd0c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f96ac034040 tx=0x7f96ac004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:38.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.208+0000 7f96b0ff9640 1 -- 172.21.15.33:0/3060378465 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac041020 con 0x7f96b4148190 2024-04-25T15:30:38.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.208+0000 7f96b0ff9640 1 -- 172.21.15.33:0/3060378465 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac007780 con 0x7f96b4148190 2024-04-25T15:30:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.210+0000 7f96b0ff9640 1 -- 172.21.15.33:0/3060378465 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac036040 con 0x7f96b4148190 2024-04-25T15:30:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.211+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b4153b70 con 0x7f96b4148190 2024-04-25T15:30:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.211+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b4154c30 con 0x7f96b4148190 2024-04-25T15:30:38.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.213+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b4152f00 con 0x7f96b4148190 2024-04-25T15:30:38.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.217+0000 7f96b0ff9640 1 -- 172.21.15.33:0/3060378465 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f96ac044020 con 0x7f96b4148190 2024-04-25T15:30:38.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.218+0000 7f96b0ff9640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f96a0074580 0x7f96a0076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.218+0000 7f96b0ff9640 1 -- 172.21.15.33:0/3060378465 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f96ac0b6470 con 0x7f96b4148190 2024-04-25T15:30:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.219+0000 7f96b3fff640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f96a0074580 0x7f96a0076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.220+0000 7f96b3fff640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f96a0074580 0x7f96a0076a90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96a40098e0 tx=0x7f96a4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:38.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.224+0000 7f96b0ff9640 1 -- 172.21.15.33:0/3060378465 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f96ac04b030 con 0x7f96b4148190 2024-04-25T15:30:38.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.582+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96b40764e0 con 0x7f96b4148190 2024-04-25T15:30:38.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.584+0000 7f96b0ff9640 1 -- 172.21.15.33:0/3060378465 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7f96ac080c50 con 0x7f96b4148190 2024-04-25T15:30:38.586 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-04-25T15:30:38.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f96a0074580 msgr2=0x7f96a0076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f96a0074580 0x7f96a0076a90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96a40098e0 tx=0x7f96a4009060 comp rx=0 tx=0).stop 2024-04-25T15:30:38.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4148190 msgr2=0x7f96b41fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4148190 0x7f96b41fd0c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f96ac034040 tx=0x7f96ac004a40 comp rx=0 tx=0).stop 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 shutdown_connections 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f96a0074580 0x7f96a0076a90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96b4148190 0x7f96b41fd0c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96b40b23e0 0x7f96b414af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 --2- 172.21.15.33:0/3060378465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96b4070550 0x7f96b4153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 >> 172.21.15.33:0/3060378465 conn(0x7f96b4063ad0 msgr2=0x7f96b4147100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 shutdown_connections 2024-04-25T15:30:38.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.588+0000 7f96ba86e640 1 -- 172.21.15.33:0/3060378465 wait complete. 2024-04-25T15:30:38.607 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T15:30:38.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.787+0000 7f329da6e640 1 Processor -- start 2024-04-25T15:30:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.787+0000 7f329da6e640 1 -- start start 2024-04-25T15:30:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f329da6e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298149800 0x7f32980b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f329da6e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3298143560 0x7f3298143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f329da6e640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3298149d90 con 0x7f3298073870 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f329da6e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f329814a070 con 0x7f3298143560 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f329da6e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f329814a350 con 0x7f3298149800 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f3297fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3298143560 0x7f3298143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f32977fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298149800 0x7f32980b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f3296ffd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3298073870 0x7f3298071da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43600/0 (socket says 172.21.15.33:43600) 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f32977fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298149800 0x7f32980b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:38798/0 (socket says 172.21.15.33:38798) 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f3297fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3298143560 0x7f3298143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:56570/0 (socket says 172.21.15.33:56570) 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.789+0000 7f32977fe640 1 -- 172.21.15.33:0/4094430901 learned_addr learned my addr 172.21.15.33:0/4094430901 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.790+0000 7f3297fff640 1 -- 172.21.15.33:0/4094430901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298149800 msgr2=0x7f32980b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:38.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.790+0000 7f3297fff640 1 --2- 172.21.15.33:0/4094430901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298149800 0x7f32980b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.790+0000 7f3297fff640 1 -- 172.21.15.33:0/4094430901 >> v1:172.21.15.33:6789/0 conn(0x7f3298073870 legacy=0x7f3298071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.790+0000 7f3297fff640 1 -- 172.21.15.33:0/4094430901 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3298143eb0 con 0x7f3298143560 2024-04-25T15:30:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.791+0000 7f3297fff640 1 --2- 172.21.15.33:0/4094430901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298143560 0x7f3298143970 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3290009d90 tx=0x7f329002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4594b58f35e98d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.791+0000 7f32967fc640 1 -- 172.21.15.33:0/4094430901 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290007740 con 0x7f3298143560 2024-04-25T15:30:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.791+0000 7f32967fc640 1 -- 172.21.15.33:0/4094430901 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32900078e0 con 0x7f3298143560 2024-04-25T15:30:38.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.791+0000 7f32967fc640 1 -- 172.21.15.33:0/4094430901 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290007cb0 con 0x7f3298143560 2024-04-25T15:30:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.792+0000 7f329da6e640 1 -- 172.21.15.33:0/4094430901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298143560 msgr2=0x7f3298143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.792+0000 7f329da6e640 1 --2- 172.21.15.33:0/4094430901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298143560 0x7f3298143970 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3290009d90 tx=0x7f329002a660 comp rx=0 tx=0).stop 2024-04-25T15:30:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.794+0000 7f329da6e640 1 -- 172.21.15.33:0/4094430901 shutdown_connections 2024-04-25T15:30:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.794+0000 7f329da6e640 1 --2- 172.21.15.33:0/4094430901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298143560 0x7f3298143970 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.794+0000 7f329da6e640 1 --2- 172.21.15.33:0/4094430901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298149800 0x7f32980b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.794+0000 7f329da6e640 1 -- 172.21.15.33:0/4094430901 >> 172.21.15.33:0/4094430901 conn(0x7f32980bb2e0 msgr2=0x7f32980bb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.794+0000 7f329da6e640 1 -- 172.21.15.33:0/4094430901 shutdown_connections 2024-04-25T15:30:38.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.794+0000 7f329da6e640 1 -- 172.21.15.33:0/4094430901 wait complete. 2024-04-25T15:30:38.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.796+0000 7f329da6e640 1 Processor -- start 2024-04-25T15:30:38.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.797+0000 7f329da6e640 1 -- start start 2024-04-25T15:30:38.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f329da6e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298073870 0x7f3298144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.799 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f329da6e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3298143560 0x7f329813b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f329da6e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298149800 0x7f329813b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f3296ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3298143560 0x7f329813b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f32977fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298073870 0x7f3298144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f32977fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298073870 0x7f3298144350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:38806/0 (socket says 172.21.15.33:38806) 2024-04-25T15:30:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f3296ffd640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3298143560 0x7f329813b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45350/0 (socket says 172.21.15.33:45350) 2024-04-25T15:30:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f32977fe640 1 -- 172.21.15.33:0/649586364 learned_addr learned my addr 172.21.15.33:0/649586364 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.798+0000 7f329da6e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f3298072630 con 0x7f3298143560 2024-04-25T15:30:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f32980724b0 con 0x7f3298149800 2024-04-25T15:30:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f32981540a0 con 0x7f3298073870 2024-04-25T15:30:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f3297fff640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298149800 0x7f329813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f3296ffd640 1 -- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298073870 msgr2=0x7f3298144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f3296ffd640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298073870 0x7f3298144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f3296ffd640 1 -- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298149800 msgr2=0x7f329813b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f3296ffd640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298149800 0x7f329813b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f3296ffd640 1 -- 172.21.15.33:0/649586364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329813bca0 con 0x7f3298143560 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.799+0000 7f3297fff640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298149800 0x7f329813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.800+0000 7f3296ffd640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3298143560 0x7f329813b220 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c390 tx=0x7f328c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.800+0000 7f327ffff640 1 -- 172.21.15.33:0/649586364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c0074e0 con 0x7f3298143560 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.800+0000 7f327ffff640 1 -- 172.21.15.33:0/649586364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328c007680 con 0x7f3298143560 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.801+0000 7f327ffff640 1 -- 172.21.15.33:0/649586364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c0049e0 con 0x7f3298143560 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.801+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329814d750 con 0x7f3298143560 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.801+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3298144d40 con 0x7f3298143560 2024-04-25T15:30:38.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.802+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329813d850 con 0x7f3298143560 2024-04-25T15:30:38.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.804+0000 7f327ffff640 1 -- 172.21.15.33:0/649586364 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f328c01a020 con 0x7f3298143560 2024-04-25T15:30:38.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.804+0000 7f327ffff640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f32840745b0 0x7f3284076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:38.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.804+0000 7f327ffff640 1 -- 172.21.15.33:0/649586364 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f328c0948d0 con 0x7f3298143560 2024-04-25T15:30:38.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.805+0000 7f32977fe640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f32840745b0 0x7f3284076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:38.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.807+0000 7f32977fe640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f32840745b0 0x7f3284076ac0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3288006f40 tx=0x7f3288009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:38.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:38.815+0000 7f327ffff640 1 -- 172.21.15.33:0/649586364 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f329813d850 con 0x7f3298143560 2024-04-25T15:30:39.186 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.185+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f32980764e0 con 0x7f3298143560 2024-04-25T15:30:39.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.186+0000 7f327ffff640 1 -- 172.21.15.33:0/649586364 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) ==== 104+0+11 (secure 0 0 0) 0x7f328c05e910 con 0x7f3298143560 2024-04-25T15:30:39.188 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f32840745b0 msgr2=0x7f3284076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f32840745b0 0x7f3284076ac0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3288006f40 tx=0x7f3288009240 comp rx=0 tx=0).stop 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3298143560 msgr2=0x7f329813b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3298143560 0x7f329813b220 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c390 tx=0x7f328c00c850 comp rx=0 tx=0).stop 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 shutdown_connections 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f32840745b0 0x7f3284076ac0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3298149800 0x7f329813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3298143560 0x7f329813b220 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 --2- 172.21.15.33:0/649586364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3298073870 0x7f3298144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.189+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 >> 172.21.15.33:0/649586364 conn(0x7f32980bb2e0 msgr2=0x7f3298073000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.190+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 shutdown_connections 2024-04-25T15:30:39.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.190+0000 7f329da6e640 1 -- 172.21.15.33:0/649586364 wait complete. 2024-04-25T15:30:39.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T15:30:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.396+0000 7fde9c991640 1 Processor -- start 2024-04-25T15:30:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.396+0000 7fde9c991640 1 -- start start 2024-04-25T15:30:39.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.398+0000 7fde9c991640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde9809cf80 0x7fde980b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.398+0000 7fde9c991640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde9806dfa0 0x7fde980b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.398+0000 7fde9c991640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde980ba4b0 con 0x7fde9806e3b0 2024-04-25T15:30:39.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.398+0000 7fde9c991640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fde98145cf0 con 0x7fde9806dfa0 2024-04-25T15:30:39.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.398+0000 7fde9c991640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde9806f560 con 0x7fde9809cf80 2024-04-25T15:30:39.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.399+0000 7fde97fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fde9806e3b0 0x7fde9806ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:45444/0 (socket says 172.21.15.33:45444) 2024-04-25T15:30:39.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.399+0000 7fde97fff640 1 -- 172.21.15.33:0/3696231748 learned_addr learned my addr 172.21.15.33:0/3696231748 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.399+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162964713 0 0) 0x7fde980ba4b0 con 0x7fde9806e3b0 2024-04-25T15:30:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.400+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde80003520 con 0x7fde9806e3b0 2024-04-25T15:30:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.400+0000 7fde977fe640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde9809cf80 0x7fde980b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:39.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.400+0000 7fde96ffd640 1 --2- 172.21.15.33:0/3696231748 >> v2:172.21.15.155:3300/0 conn(0x7fde9806dfa0 0x7fde980b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.400+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 683260667 0 0) 0x7fde80003520 con 0x7fde9806e3b0 2024-04-25T15:30:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.400+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde9809cf80 msgr2=0x7fde980b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.400+0000 7fde967fc640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde9809cf80 0x7fde980b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.400+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 >> v2:172.21.15.155:3300/0 conn(0x7fde9806dfa0 msgr2=0x7fde980b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.400+0000 7fde967fc640 1 --2- 172.21.15.33:0/3696231748 >> v2:172.21.15.155:3300/0 conn(0x7fde9806dfa0 0x7fde980b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.401+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde981464f0 con 0x7fde9806e3b0 2024-04-25T15:30:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.401+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7fde8c001690 con 0x7fde9806e3b0 2024-04-25T15:30:39.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.401+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 >> v1:172.21.15.155:6789/0 conn(0x7fde9806e3b0 legacy=0x7fde9806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.401+0000 7fde967fc640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde800039b0 0x7fde80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.401+0000 7fde967fc640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80004800 0x7fde80004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.401+0000 7fde967fc640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde80005150 0x7fde8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.401+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fde98145cf0 con 0x7fde80004800 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.401+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde9806f560 con 0x7fde800039b0 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.402+0000 7fde97fff640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde80005150 0x7fde8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.402+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde8000bf80 con 0x7fde80005150 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.402+0000 7fde96ffd640 1 --2- 172.21.15.33:0/3696231748 >> v2:172.21.15.155:3300/0 conn(0x7fde9806dfa0 0x7fde980b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.402+0000 7fde96ffd640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80004800 0x7fde80004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.403+0000 7fde96ffd640 1 -- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde80005150 msgr2=0x7fde8000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.403+0000 7fde96ffd640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde80005150 0x7fde8000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.403+0000 7fde96ffd640 1 -- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde800039b0 msgr2=0x7fde80003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:30:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.403+0000 7fde96ffd640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde800039b0 0x7fde80003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.403+0000 7fde96ffd640 1 -- 172.21.15.33:0/3696231748 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde80003520 con 0x7fde80004800 2024-04-25T15:30:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.404+0000 7fde977fe640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde9809cf80 0x7fde980b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:30:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.404+0000 7fde97fff640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde80005150 0x7fde8000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:30:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.404+0000 7fde96ffd640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80004800 0x7fde80004c10 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fde980b4d70 tx=0x7fde80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4ccb740e51db19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:39.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.407+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90033070 con 0x7fde80004800 2024-04-25T15:30:39.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.407+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde90003b90 con 0x7fde80004800 2024-04-25T15:30:39.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.407+0000 7fde967fc640 1 -- 172.21.15.33:0/3696231748 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90009dc0 con 0x7fde80004800 2024-04-25T15:30:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.409+0000 7fde9c991640 1 -- 172.21.15.33:0/3696231748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80004800 msgr2=0x7fde80004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.409+0000 7fde9c991640 1 --2- 172.21.15.33:0/3696231748 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde80004800 0x7fde80004c10 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7fde980b4d70 tx=0x7fde80005830 comp rx=0 tx=0).stop 2024-04-25T15:30:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.409+0000 7fde97fff640 1 -- 172.21.15.33:0/3696231748 reap_dead start 2024-04-25T15:30:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.409+0000 7fde9c991640 1 -- 172.21.15.33:0/3696231748 shutdown_connections 2024-04-25T15:30:39.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.409+0000 7fde9c991640 1 -- 172.21.15.33:0/3696231748 >> 172.21.15.33:0/3696231748 conn(0x7fde9809c460 msgr2=0x7fde9809c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.412+0000 7fde9c991640 1 -- 172.21.15.33:0/3696231748 shutdown_connections 2024-04-25T15:30:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.413+0000 7fde9c991640 1 -- 172.21.15.33:0/3696231748 wait complete. 2024-04-25T15:30:39.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.416+0000 7fde9c991640 1 Processor -- start 2024-04-25T15:30:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.416+0000 7fde9c991640 1 -- start start 2024-04-25T15:30:39.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde9c991640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde98141570 0x7fde98141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde977fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde98141570 0x7fde98141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde977fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde98141570 0x7fde98141e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45370/0 (socket says 172.21.15.33:45370) 2024-04-25T15:30:39.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde977fe640 1 -- 172.21.15.33:0/1118776776 learned_addr learned my addr 172.21.15.33:0/1118776776 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde9c991640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde981e74b0 0x7fde981e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde9c991640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde981e7e00 0x7fde98072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fde980b68f0 con 0x7fde98141570 2024-04-25T15:30:39.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde980b6770 con 0x7fde981e74b0 2024-04-25T15:30:39.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.418+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde980b5140 con 0x7fde981e7e00 2024-04-25T15:30:39.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.419+0000 7fde977fe640 1 -- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde981e7e00 msgr2=0x7fde98072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:39.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.419+0000 7fde977fe640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde981e7e00 0x7fde98072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.419+0000 7fde977fe640 1 -- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde981e74b0 msgr2=0x7fde981e78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:39.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.419+0000 7fde977fe640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde981e74b0 0x7fde981e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.419+0000 7fde977fe640 1 -- 172.21.15.33:0/1118776776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde98074350 con 0x7fde98141570 2024-04-25T15:30:39.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.419+0000 7fde977fe640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde98141570 0x7fde98141e10 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fde8800d410 tx=0x7fde8800d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:39.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.420+0000 7fde7ffff640 1 -- 172.21.15.33:0/1118776776 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88004030 con 0x7fde98141570 2024-04-25T15:30:39.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.420+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde98073fe0 con 0x7fde98141570 2024-04-25T15:30:39.424 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.421+0000 7fde7ffff640 1 -- 172.21.15.33:0/1118776776 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde880041d0 con 0x7fde98141570 2024-04-25T15:30:39.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.421+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde981467f0 con 0x7fde98141570 2024-04-25T15:30:39.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.421+0000 7fde7ffff640 1 -- 172.21.15.33:0/1118776776 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88003610 con 0x7fde98141570 2024-04-25T15:30:39.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.423+0000 7fde7ffff640 1 -- 172.21.15.33:0/1118776776 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fde880037b0 con 0x7fde98141570 2024-04-25T15:30:39.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.424+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde78005290 con 0x7fde98141570 2024-04-25T15:30:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.424+0000 7fde7ffff640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde84074500 0x7fde84076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.424+0000 7fde7ffff640 1 -- 172.21.15.33:0/1118776776 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7fde88094fb0 con 0x7fde98141570 2024-04-25T15:30:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.425+0000 7fde96ffd640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde84074500 0x7fde84076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:39.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.425+0000 7fde96ffd640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde84074500 0x7fde84076a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde90034000 tx=0x7fde9002d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:39.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.433+0000 7fde7ffff640 1 -- 172.21.15.33:0/1118776776 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde8805f860 con 0x7fde98141570 2024-04-25T15:30:39.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.810+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fde78005850 con 0x7fde98141570 2024-04-25T15:30:39.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.812+0000 7fde7ffff640 1 -- 172.21.15.33:0/1118776776 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) ==== 100+0+11 (secure 0 0 0) 0x7fde8805f160 con 0x7fde98141570 2024-04-25T15:30:39.814 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-04-25T15:30:39.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde84074500 msgr2=0x7fde84076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:39.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde84074500 0x7fde84076a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde90034000 tx=0x7fde9002d000 comp rx=0 tx=0).stop 2024-04-25T15:30:39.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde98141570 msgr2=0x7fde98141e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde98141570 0x7fde98141e10 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fde8800d410 tx=0x7fde8800d8d0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 shutdown_connections 2024-04-25T15:30:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fde84074500 0x7fde84076a10 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde90034000 tx=0x7fde9002d000 comp rx=0 tx=0).stop 2024-04-25T15:30:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde981e7e00 0x7fde98072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde981e74b0 0x7fde981e78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 --2- 172.21.15.33:0/1118776776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde98141570 0x7fde98141e10 secure :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7fde8800d410 tx=0x7fde8800d8d0 comp rx=0 tx=0).stop 2024-04-25T15:30:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.816+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 >> 172.21.15.33:0/1118776776 conn(0x7fde9809c460 msgr2=0x7fde98075ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:39.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.819+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 shutdown_connections 2024-04-25T15:30:39.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:39.820+0000 7fde9c991640 1 -- 172.21.15.33:0/1118776776 wait complete. 2024-04-25T15:30:39.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-25T15:30:40.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.018+0000 7f773a84c640 1 Processor -- start 2024-04-25T15:30:40.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.018+0000 7f773a84c640 1 -- start start 2024-04-25T15:30:40.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.019+0000 7f773a84c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734147af0 0x7f77340bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:40.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.020+0000 7f773a84c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f77340b6a30 0x7f77340b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:40.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.020+0000 7f773a84c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7734073310 con 0x7f7734151080 2024-04-25T15:30:40.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.020+0000 7f773a84c640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f77340740a0 con 0x7f77340b6a30 2024-04-25T15:30:40.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.020+0000 7f773a84c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77340735f0 con 0x7f7734147af0 2024-04-25T15:30:40.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.021+0000 7f7733fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734147af0 0x7f77340bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:40.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.021+0000 7f7733fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734147af0 0x7f77340bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:38852/0 (socket says 172.21.15.33:38852) 2024-04-25T15:30:40.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.021+0000 7f7733fff640 1 -- 172.21.15.33:0/4025566461 learned_addr learned my addr 172.21.15.33:0/4025566461 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.021+0000 7f7733fff640 1 -- 172.21.15.33:0/4025566461 >> v2:172.21.15.33:3300/0 conn(0x7f77340b6a30 msgr2=0x7f77340b6e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:30:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.021+0000 7f7733fff640 1 --2- 172.21.15.33:0/4025566461 >> v2:172.21.15.33:3300/0 conn(0x7f77340b6a30 0x7f77340b6e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.021+0000 7f7733fff640 1 -- 172.21.15.33:0/4025566461 >> v1:172.21.15.155:6789/0 conn(0x7f7734151080 legacy=0x7f773406c5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:30:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.021+0000 7f7733fff640 1 -- 172.21.15.33:0/4025566461 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77340738d0 con 0x7f7734147af0 2024-04-25T15:30:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.025+0000 7f7733fff640 1 --2- 172.21.15.33:0/4025566461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734147af0 0x7f77340bbf60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f772c009e50 tx=0x7f772c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc82958e5049f53f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.026+0000 7f7732ffd640 1 -- 172.21.15.33:0/4025566461 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c036070 con 0x7f7734147af0 2024-04-25T15:30:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.026+0000 7f7732ffd640 1 -- 172.21.15.33:0/4025566461 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c031600 con 0x7f7734147af0 2024-04-25T15:30:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.026+0000 7f7732ffd640 1 -- 172.21.15.33:0/4025566461 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c0319d0 con 0x7f7734147af0 2024-04-25T15:30:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.028+0000 7f773a84c640 1 -- 172.21.15.33:0/4025566461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734147af0 msgr2=0x7f77340bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.028+0000 7f773a84c640 1 --2- 172.21.15.33:0/4025566461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734147af0 0x7f77340bbf60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f772c009e50 tx=0x7f772c02a660 comp rx=0 tx=0).stop 2024-04-25T15:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.029+0000 7f773a84c640 1 -- 172.21.15.33:0/4025566461 shutdown_connections 2024-04-25T15:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.029+0000 7f773a84c640 1 --2- 172.21.15.33:0/4025566461 >> v2:172.21.15.33:3300/0 conn(0x7f77340b6a30 0x7f77340b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.029+0000 7f773a84c640 1 --2- 172.21.15.33:0/4025566461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734147af0 0x7f77340bbf60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.029+0000 7f773a84c640 1 -- 172.21.15.33:0/4025566461 >> 172.21.15.33:0/4025566461 conn(0x7f77340b8b10 msgr2=0x7f77340bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.029+0000 7f773a84c640 1 -- 172.21.15.33:0/4025566461 shutdown_connections 2024-04-25T15:30:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.029+0000 7f773a84c640 1 -- 172.21.15.33:0/4025566461 wait complete. 2024-04-25T15:30:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.032+0000 7f773a84c640 1 Processor -- start 2024-04-25T15:30:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.034+0000 7f773a84c640 1 -- start start 2024-04-25T15:30:40.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.036+0000 7f773a84c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77340b6a30 0x7f773414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.037+0000 7f7733fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77340b6a30 0x7f773414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.037+0000 7f7733fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77340b6a30 0x7f773414a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45378/0 (socket says 172.21.15.33:45378) 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.037+0000 7f7733fff640 1 -- 172.21.15.33:0/3204448056 learned_addr learned my addr 172.21.15.33:0/3204448056 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.037+0000 7f773a84c640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7734147af0 0x7f7734142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.037+0000 7f773a84c640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734151080 0x7f77341e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.037+0000 7f77337fe640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7734147af0 0x7f7734142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.037+0000 7f7738de9640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734151080 0x7f77341e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.037+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f77340bc620 con 0x7f77340b6a30 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.038+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f77340bc4a0 con 0x7f7734147af0 2024-04-25T15:30:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.038+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7734151490 con 0x7f7734151080 2024-04-25T15:30:40.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.038+0000 7f7733fff640 1 -- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734151080 msgr2=0x7f77341e71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:40.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.038+0000 7f7733fff640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734151080 0x7f77341e71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:40.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.038+0000 7f7733fff640 1 -- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7734147af0 msgr2=0x7f7734142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:40.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.038+0000 7f7733fff640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7734147af0 0x7f7734142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:40.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.038+0000 7f7733fff640 1 -- 172.21.15.33:0/3204448056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773414abc0 con 0x7f77340b6a30 2024-04-25T15:30:40.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.039+0000 7f7733fff640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77340b6a30 0x7f773414a390 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f772c009e50 tx=0x7f772c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.041+0000 7f7730ff9640 1 -- 172.21.15.33:0/3204448056 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c041030 con 0x7f77340b6a30 2024-04-25T15:30:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.041+0000 7f7730ff9640 1 -- 172.21.15.33:0/3204448056 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c037040 con 0x7f77340b6a30 2024-04-25T15:30:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.041+0000 7f7730ff9640 1 -- 172.21.15.33:0/3204448056 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c036070 con 0x7f77340b6a30 2024-04-25T15:30:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.041+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77341e3e50 con 0x7f77340b6a30 2024-04-25T15:30:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.041+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77341e4410 con 0x7f77340b6a30 2024-04-25T15:30:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.044+0000 7f7730ff9640 1 -- 172.21.15.33:0/3204448056 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f772c044070 con 0x7f77340b6a30 2024-04-25T15:30:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.044+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7714005290 con 0x7f77340b6a30 2024-04-25T15:30:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.048+0000 7f7730ff9640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7720074580 0x7f7720076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.048+0000 7f7730ff9640 1 -- 172.21.15.33:0/3204448056 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f772c0b5bb0 con 0x7f77340b6a30 2024-04-25T15:30:40.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.051+0000 7f77337fe640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7720074580 0x7f7720076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:40.056 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.054+0000 7f77337fe640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7720074580 0x7f7720076a90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7728006fd0 tx=0x7f7728008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:40.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.055+0000 7f7730ff9640 1 -- 172.21.15.33:0/3204448056 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f772c04b070 con 0x7f77340b6a30 2024-04-25T15:30:40.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.545+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f7714005580 con 0x7f77340b6a30 2024-04-25T15:30:40.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.556+0000 7f7730ff9640 1 -- 172.21.15.33:0/3204448056 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) ==== 81+0+509821 (secure 0 0 0) 0x7f772c080300 con 0x7f77340b6a30 2024-04-25T15:30:40.565 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:30:40.565 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:40.565 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 5, 2024-04-25T15:30:40.565 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.565 INFO:teuthology.orchestra.run.smithi033.stdout: "active_gid": 4100, 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "active_name": "x", 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addrs": { 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.155:6832", 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 794053036 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.155:6833", 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 794053036 2024-04-25T15:30:40.566 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addr": "172.21.15.155:6833/794053036", 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "active_change": "2024-04-25T15:20:21.693467+0000", 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "active_mgr_features": 4540701547738038271, 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "available": true, 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "standbys": [ 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 4110, 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "y", 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540701547738038271, 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-04-25T15:30:40.567 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.568 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.569 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.570 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.571 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.572 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.573 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-04-25T15:30:40.574 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.575 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.576 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-04-25T15:30:40.577 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.578 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T15:30:40.579 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.580 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.581 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.582 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.583 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.584 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T15:30:40.585 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T15:30:40.586 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.587 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.589 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.590 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.591 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.592 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-04-25T15:30:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.597 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.598 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.599 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.600 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.601 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.602 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.603 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T15:30:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.607 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.608 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.610 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-04-25T15:30:40.611 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-04-25T15:30:40.612 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-04-25T15:30:40.613 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.614 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.615 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.616 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T15:30:40.617 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T15:30:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.619 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.620 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.621 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.623 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-04-25T15:30:40.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.625 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-04-25T15:30:40.626 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.627 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-04-25T15:30:40.628 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.629 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.630 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.631 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.632 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.633 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-04-25T15:30:40.634 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.635 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.636 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T15:30:40.637 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T15:30:40.638 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.639 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.640 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.641 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.642 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.643 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T15:30:40.644 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.646 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T15:30:40.647 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.648 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.649 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-04-25T15:30:40.650 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.651 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.652 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.653 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.654 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.655 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.656 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.657 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.658 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.659 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.660 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.662 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.663 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.664 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.665 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.668 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.670 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T15:30:40.671 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.672 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.673 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.674 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.675 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T15:30:40.677 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.678 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.680 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.681 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.682 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T15:30:40.684 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.685 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.686 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "[]", 2024-04-25T15:30:40.687 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "{}", 2024-04-25T15:30:40.688 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.689 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.690 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.691 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.692 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.693 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.694 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T15:30:40.696 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.697 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.698 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:40.699 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.700 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.701 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.704 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.705 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.707 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T15:30:40.708 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.709 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.710 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.711 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.712 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.713 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.718 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-04-25T15:30:40.719 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-04-25T15:30:40.720 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.721 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.722 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.723 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.724 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.725 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.726 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.727 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.728 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.730 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.731 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.732 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.733 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.734 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.735 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.736 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.737 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.738 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.739 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.740 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.741 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-04-25T15:30:40.742 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.744 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.745 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.746 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.747 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.748 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.749 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.750 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-04-25T15:30:40.751 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.752 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.753 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-04-25T15:30:40.755 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.756 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.757 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:40.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.759 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.760 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.761 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.762 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.763 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.764 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.765 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-04-25T15:30:40.766 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.768 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-04-25T15:30:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.771 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-04-25T15:30:40.773 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.774 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.775 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.776 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.777 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.778 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.779 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.780 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.781 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.782 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.783 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.784 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.785 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.786 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.787 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.788 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.789 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.790 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.791 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.792 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.793 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.794 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.795 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.796 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.797 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-04-25T15:30:40.798 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.799 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.800 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.801 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.802 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.803 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T15:30:40.804 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.805 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.806 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.807 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.808 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.809 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.810 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.811 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.813 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.815 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.816 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.817 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.818 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.819 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.820 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.821 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.822 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.823 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.824 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.825 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.826 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.827 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.832 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.833 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.834 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-04-25T15:30:40.835 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.836 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.837 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.838 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.840 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.841 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.844 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.847 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.848 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.849 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.850 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.851 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-04-25T15:30:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.853 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.855 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.856 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.857 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.858 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.859 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.860 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-04-25T15:30:40.861 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-04-25T15:30:40.862 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.863 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.864 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.865 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.866 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.867 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.868 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.869 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.871 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.872 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.873 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.874 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.875 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.876 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.877 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.878 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.879 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.880 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.882 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.883 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.884 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-04-25T15:30:40.885 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.886 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.887 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.889 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.890 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-04-25T15:30:40.891 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-04-25T15:30:40.892 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.893 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.894 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.895 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.896 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.897 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.898 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.899 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.900 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.901 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.906 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.907 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.908 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.909 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.911 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.912 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.913 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.914 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.915 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.916 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.917 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.918 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.919 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.920 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.921 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.922 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.924 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.925 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.926 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.927 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.928 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.931 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.932 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.933 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.934 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.935 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.936 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.937 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-04-25T15:30:40.938 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.939 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.940 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.941 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.942 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.943 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.944 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-04-25T15:30:40.945 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.946 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.947 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.948 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.949 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.950 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.951 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.954 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.955 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.956 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.957 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.958 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.959 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.960 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.961 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.962 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.963 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.964 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.965 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.966 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.967 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.968 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.969 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.970 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.971 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.972 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.972 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.973 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.973 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.973 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.973 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.973 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.974 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.975 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-04-25T15:30:40.976 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.977 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.978 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.979 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.980 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.981 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.982 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.983 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.984 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T15:30:40.985 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.986 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.987 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-04-25T15:30:40.988 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.989 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.990 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.991 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.992 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.993 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.994 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:40.995 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.996 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.002 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.004 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.005 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.006 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.007 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.008 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.009 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.010 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.011 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.012 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.013 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-04-25T15:30:41.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.015 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.016 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.017 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.018 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-04-25T15:30:41.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.020 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.025 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.026 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.027 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.029 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.030 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "modules": [ 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "iostat", 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "nfs", 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "restful" 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.031 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.033 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.034 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.035 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.036 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.039 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.040 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.041 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-04-25T15:30:41.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-04-25T15:30:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.044 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.045 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.046 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-04-25T15:30:41.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-04-25T15:30:41.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:41.049 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.050 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.052 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-04-25T15:30:41.053 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.054 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.055 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.056 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.058 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-04-25T15:30:41.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "read", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap-read" 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.060 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.061 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.063 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:41.065 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.066 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.067 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.068 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-25T15:30:41.069 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-25T15:30:41.070 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm_log_destination": { 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm_log_destination", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "file", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "file,syslog", 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: "syslog" 2024-04-25T15:30:41.071 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-25T15:30:41.073 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-25T15:30:41.074 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.075 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-04-25T15:30:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-04-25T15:30:41.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.083 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-25T15:30:41.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-25T15:30:41.086 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-25T15:30:41.087 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_samba": { 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_samba", 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-25T15:30:41.088 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Samba/SMB container image", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.089 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.090 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.091 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.092 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-25T15:30:41.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-04-25T15:30:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.095 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.096 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "grafana_dashboards_path": { 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "grafana_dashboards_path", 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.099 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.102 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.103 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.104 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.105 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.106 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.107 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.109 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.110 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-04-25T15:30:41.111 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.112 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-25T15:30:41.113 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-25T15:30:41.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.119 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-04-25T15:30:41.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.122 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.124 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.125 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.126 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.127 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.129 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.130 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-04-25T15:30:41.131 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.132 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-25T15:30:41.133 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.134 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.135 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.136 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.137 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.138 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.140 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.141 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.143 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.144 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.147 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-25T15:30:41.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.150 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.152 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.153 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.154 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "[]", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "MULTICLUSTER_CONFIG": { 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "{}", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.157 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.158 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.159 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.160 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.165 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.166 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.168 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-25T15:30:41.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-25T15:30:41.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.171 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.173 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.174 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.175 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.176 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.177 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.178 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-04-25T15:30:41.180 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.182 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.183 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.184 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.186 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.187 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-04-25T15:30:41.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.190 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.191 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.192 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.194 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.195 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.196 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.197 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.198 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.199 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.200 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.201 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.203 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-04-25T15:30:41.204 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.205 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.206 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:41.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.208 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.210 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.211 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.212 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.213 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.214 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.216 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-04-25T15:30:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-04-25T15:30:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-04-25T15:30:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-04-25T15:30:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.233 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.234 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.235 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.236 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.237 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.238 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.240 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.241 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.242 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.243 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.244 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.245 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.246 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.247 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.248 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.249 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.250 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.251 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.252 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.253 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.254 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.255 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.256 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.257 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.258 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.259 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.260 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.261 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.262 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.263 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.264 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.265 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.266 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.267 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.271 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.272 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.273 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.274 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.275 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.276 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-04-25T15:30:41.277 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.278 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.279 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.280 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.281 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.282 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.283 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.285 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.286 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.287 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.288 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.290 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.292 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.293 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.294 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.295 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.298 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.299 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.300 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.301 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.302 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.303 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.305 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.306 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.307 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.308 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.309 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.310 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.311 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-04-25T15:30:41.312 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.313 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.314 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.315 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-04-25T15:30:41.316 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.317 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.318 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.319 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.320 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.321 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.323 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.324 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-25T15:30:41.325 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.326 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.327 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.330 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.331 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.333 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.334 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.335 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.336 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.337 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.338 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.339 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.340 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.341 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.342 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.343 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.344 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.345 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.347 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.348 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.349 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.350 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.351 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.354 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.355 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.356 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.357 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.358 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.359 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.360 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.361 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.362 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.363 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.366 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.367 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.368 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-04-25T15:30:41.371 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.372 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.373 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.374 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-04-25T15:30:41.375 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.376 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.377 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.378 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.380 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.381 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.382 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.383 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.385 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.386 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.387 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.388 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.389 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.390 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.391 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.392 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.394 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.395 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.396 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.397 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.398 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.399 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-04-25T15:30:41.401 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.403 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.404 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.407 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.408 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-04-25T15:30:41.409 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-04-25T15:30:41.411 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-04-25T15:30:41.412 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.413 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.414 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.415 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-25T15:30:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.418 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.419 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.420 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.421 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.421 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.421 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.421 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.421 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.421 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-04-25T15:30:41.421 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-04-25T15:30:41.422 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.422 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.422 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.422 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.422 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.422 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.422 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.422 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.423 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.423 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.423 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.423 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.423 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.423 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.423 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.424 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.425 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.425 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.425 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.425 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.425 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.425 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.425 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.426 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.426 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.426 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.426 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.426 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.426 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.427 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.428 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.430 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.431 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.432 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.434 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.435 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.437 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.438 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.440 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.441 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.443 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.444 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.445 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "periodic_async_work": { 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "periodic_async_work", 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Periodically check for async work", 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.447 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.449 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.450 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.452 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.453 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-04-25T15:30:41.455 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "sqlite3_killpoint": { 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sqlite3_killpoint", 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "dev", 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.458 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-04-25T15:30:41.459 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-04-25T15:30:41.460 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "services": {}, 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "always_on_modules": { 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "octopus": [ 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-04-25T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "pacific": [ 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "quincy": [ 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-04-25T15:30:41.463 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "reef": [ 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-04-25T15:30:41.464 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "squid": [ 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-04-25T15:30:41.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: "last_failure_osd_epoch": 0, 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: "active_clients": [ 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.155:0", 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 4020791213 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "libcephsqlite", 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.155:0", 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 864399315 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.155:0", 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 2986228201 2024-04-25T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.155:0", 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 910703751 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-04-25T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.564+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7720074580 msgr2=0x7f7720076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.564+0000 7f773a84c640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7720074580 0x7f7720076a90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7728006fd0 tx=0x7f7728008040 comp rx=0 tx=0).stop 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.564+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77340b6a30 msgr2=0x7f773414a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.564+0000 7f773a84c640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77340b6a30 0x7f773414a390 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f772c009e50 tx=0x7f772c004a40 comp rx=0 tx=0).stop 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.566+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 shutdown_connections 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.566+0000 7f773a84c640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f7720074580 0x7f7720076a90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.566+0000 7f773a84c640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7734151080 0x7f77341e71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.566+0000 7f773a84c640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7734147af0 0x7f7734142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.566+0000 7f773a84c640 1 --2- 172.21.15.33:0/3204448056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77340b6a30 0x7f773414a390 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:41.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.566+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 >> 172.21.15.33:0/3204448056 conn(0x7f77340b8b10 msgr2=0x7f7734146d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:41.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.566+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 shutdown_connections 2024-04-25T15:30:41.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:40.566+0000 7f773a84c640 1 -- 172.21.15.33:0/3204448056 wait complete. 2024-04-25T15:30:41.475 DEBUG:tasks.check_counter:Getting stats from a 2024-04-25T15:30:41.475 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2024-04-25T15:30:41.664 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T15:30:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 75708, 2024-04-25T15:30:41.664 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 75338, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 22441038, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 323141256, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 353, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 3, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 5.794174573, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 2.224915886, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 1.212180358, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 1.869545176, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 75337, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 25.633815081, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000340255 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3024, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000547003, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000180 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 328720, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 427016, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 100010382, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 323106860, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 480, 2024-04-25T15:30:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 5, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 22.172197534, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 10.466134489, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 13.534896829, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.825792431, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 427014, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 16.770832993, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000039274 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 641807, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.097567799, 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000152 2024-04-25T15:30:41.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 307584 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 68524, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 88618, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 19438401, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 166966978, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 394, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 3, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 5.418643638, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 2.119373278, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 1.986151454, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 1.199162751, 2024-04-25T15:30:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 88618, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 16.834346291, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000189965 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 65687, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.012672086, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000192 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 180496, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 114800 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 1, 2024-04-25T15:30:41.669 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "finisher-MDSRank": { 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "queue_len": 0, 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "complete_latency": { 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 169915, 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 73.043165120, 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000429880 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "finisher-PurgeQueue": { 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "queue_len": 0, 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "complete_latency": { 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 25991, 2024-04-25T15:30:41.670 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 8.582736614, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000330219 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "request": 127552, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "reply": 127552, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "reply_latency": { 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 127552, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 191.025078422, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001497625 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "slow_reply": 0, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "forward": 0, 2024-04-25T15:30:41.671 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_fetch_complete": 0, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_fetch_keys": 0, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_commit": 1853, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_split": 155, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_merge": 0, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes": 45563, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_top": 113, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_bottom": 45450, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_pin_tail": 0, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_pinned": 45401, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_expired": 0, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_with_caps": 0, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": 0, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "subtrees": 2, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse": 154323, 2024-04-25T15:30:41.672 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_hit": 153773, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_forward": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_discover": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_dir_fetch": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_remote_ino": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_lock": 6, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "load_cent": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "q": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "exported": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "exported_inodes": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "imported": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "imported_inodes": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_dir_fetch": 0, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_backtrace_fetch": 508, 2024-04-25T15:30:41.673 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_peer_discover": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rfiles": 115, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rbytes": 8516156, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rsnaps": 2, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_backtrace_fetch": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_set_tag": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_backtrace_repaired": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_inotable_repaired": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dir_inodes": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dir_base_inodes": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dirfrag_rstats": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_file_inodes": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_inode_file_caps": 0, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_revoke": 71204, 2024-04-25T15:30:41.674 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_grant": 115067, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_trunc": 11, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_caps": 166955, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_caps_dirty": 43922, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_cap_release": 127, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "process_request_cap_release": 90317 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_cache": { 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_update": 0, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_update_receipt": 0, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_try_discover": 0, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_send_discover": 0, 2024-04-25T15:30:41.675 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_handle_discover": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays": 1, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays_delayed": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays_enqueuing": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_created": 28893, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_enqueued": 28891, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_reintegrated": 2, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_migrated": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_processing": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_enqueued": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_prioritized": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "recovery_started": 1, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "recovery_completed": 1, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_quiesce_path": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_quiesce_inode": 0, 2024-04-25T15:30:41.676 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_enqueue_scrub": 0, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_exportdir": 0, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_flush": 0, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_fragmentdir": 155, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_fragstats": 0, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_inodestats": 0 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_log": { 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "evlrg": 0, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "evadd": 214346, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "evex": 128378, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "evtrm": 122901, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "ev": 91445, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "evexg": 0, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "evexd": 5477, 2024-04-25T15:30:41.677 INFO:teuthology.orchestra.run.smithi033.stdout: "segadd": 299, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "segex": 171, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "segtrm": 163, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "seg": 136, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "segmjr": 8, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "segexg": 0, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "segexd": 8, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "expos": 286853848, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "wrpos": 547585713, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "rdpos": 0, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "jlat": { 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 84181, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 160.010471071, 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001900790 2024-04-25T15:30:41.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "replayed": 0 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_mem": { 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "ino": 30356, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "ino+": 69424, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "ino-": 39068, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "dir": 540, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "dir+": 1449, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "dir-": 909, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "dn": 45563, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "dn+": 98316, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "dn-": 52753, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "cap": 0, 2024-04-25T15:30:41.679 INFO:teuthology.orchestra.run.smithi033.stdout: "cap+": 33957, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "cap-": 33957, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "rss": 301400, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "heap": 231804 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_server": { 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "dispatch_client_request": 191869, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "dispatch_server_request": 0, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_request": 127552, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_session": 30231, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_peer_request": 0, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "req_create_latency": { 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 28816, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 30.814154148, 2024-04-25T15:30:41.680 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001069341 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getattr_latency": { 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 2039, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 14.889110383, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.007302163 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getfilelock_latency": { 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 7, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000836359, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000119479 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "req_link_latency": { 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 4, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.004505434, 2024-04-25T15:30:41.681 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001126358 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookup_latency": { 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 24413, 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 8.160120078, 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000334253 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookuphash_latency": { 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupino_latency": { 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 260, 2024-04-25T15:30:41.682 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.172418062, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000663146 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupname_latency": { 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupparent_latency": { 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 2, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000139555, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000069777 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupsnap_latency": { 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 210, 2024-04-25T15:30:41.683 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.028080685, 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000133717 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lssnap_latency": { 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mkdir_latency": { 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 208, 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.346209226, 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001664467 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mknod_latency": { 2024-04-25T15:30:41.684 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mksnap_latency": { 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 26, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.251972968, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.009691268 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "req_open_latency": { 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 15139, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 11.441521498, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000755764 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.685 INFO:teuthology.orchestra.run.smithi033.stdout: "req_readdir_latency": { 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 2216, 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 23.425508208, 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.010571077 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rename_latency": { 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 9, 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.020619432, 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.002291048 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "req_renamesnap_latency": { 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 1, 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.005270127, 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.005270127 2024-04-25T15:30:41.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "req_snapdiff_latency": { 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 1083, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 2.892822627, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.002671119 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmdir_latency": { 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 189, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 1.637055613, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.008661669 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmsnap_latency": { 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 24, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.254699998, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.010612499 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.687 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmxattr_latency": { 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 28, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.076403281, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.002728688 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setattr_latency": { 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 23970, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 57.291542161, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.002390135 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setdirlayout_latency": { 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.688 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setfilelock_latency": { 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 120, 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.169518227, 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001412651 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setlayout_latency": { 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setxattr_latency": { 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 47, 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 1.682096145, 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.035789279 2024-04-25T15:30:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "req_symlink_latency": { 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 13, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.007159423, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000550724 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "req_unlink_latency": { 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 28718, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 37.452253024, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001304138 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "cap_revoke_eviction": 0, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "cap_acquisition_throttle": 4, 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getvxattr_latency": { 2024-04-25T15:30:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 10, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.001061760, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000106176 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_sessions": { 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "session_count": 0, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "session_add": 1208, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "session_remove": 1208, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "sessions_open": 0, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "sessions_stale": 0, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "total_load": 29003, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "average_load": 29003, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "avg_session_uptime": 236, 2024-04-25T15:30:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: "mdthresh_evicted": 0 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T15:30:41.692 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T15:30:41.693 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 267474, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 104, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-04-25T15:30:41.694 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 6072, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 101, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 96555425, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 403162, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-04-25T15:30:41.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "objecter": { 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "op_active": 0, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "op_laggy": 0, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "op_send": 146716, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "op_send_bytes": 567326242, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "op_resend": 37, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "op_reply": 146716, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "op_latency": { 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 146716, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 1628.414571138, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.011099093 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "op_inflight": 0, 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "oplen_avg": { 2024-04-25T15:30:41.696 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 146716, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 162501 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "op": 146716, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "op_r": 823, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "op_w": 145893, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "op_rmw": 0, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "op_pg": 0, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_stat": 522, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_create": 6089, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_read": 314, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_write": 84495, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_writefull": 173, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_writesame": 0, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_append": 0, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_zero": 0, 2024-04-25T15:30:41.697 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_truncate": 3, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_delete": 52827, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_mapext": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_sparse_read": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_clonerange": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_getxattr": 508, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_setxattr": 12187, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_cmpxattr": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_rmxattr": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_resetxattrs": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_call": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_watch": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_notify": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_src_cmpxattr": 0, 2024-04-25T15:30:41.698 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_pgls": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_pgls_filter": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_other": 9, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_active": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_send": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_resend": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_ping": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_active": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_send": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_resend": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_active": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_send": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_resend": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_active": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_send": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_resend": 0, 2024-04-25T15:30:41.699 INFO:teuthology.orchestra.run.smithi033.stdout: "command_active": 0, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "command_send": 0, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "command_resend": 0, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "map_epoch": 41, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "map_full": 0, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "map_inc": 22, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_sessions": 8, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_session_open": 8, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_session_close": 0, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_laggy": 0, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_wr": 4470, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_rd": 0, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_del": 904 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "oft": { 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_objs": 1, 2024-04-25T15:30:41.700 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_kv_pairs": 0, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_updates": 0, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_removes": 0 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "osd-slow-ops": { 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "slow_ops_count": 0 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "purge_queue": { 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_ops": 0, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_ops_high_water": 513, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing": 0, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_high_water": 32, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executed_ops": 29467, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executed": 28891, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_item_in_journal": 0 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.701 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 472948, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 99310657, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 472948, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 472948, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 99310657, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.702 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-objecter_bytes": { 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 146716, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 570629497, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 146716, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 570629497, 2024-04-25T15:30:41.703 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-objecter_ops": { 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 1024, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 146716, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 146716, 2024-04-25T15:30:41.704 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 146716, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 146716, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-write_buf_throttle": { 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 3758096384, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 28891, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 3303255, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-04-25T15:30:41.705 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 28891, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 314, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 3303255, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-write_buf_throttle-0x55bbe4702750": { 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 3758096384, 2024-04-25T15:30:41.706 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 214346, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 543391409, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 214346, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 84181, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 543391409, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-04-25T15:30:41.707 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:41.709 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=155 2024-04-25T15:30:41.709 DEBUG:tasks.check_counter:Getting stats from b 2024-04-25T15:30:41.709 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2024-04-25T15:30:41.882 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 4, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 4, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1568, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 448, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 4, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 0, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.003170456, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.000039363, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.002231861, 2024-04-25T15:30:41.883 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.003952139, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001317379 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 448 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-04-25T15:30:41.884 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 165, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 163, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 144651, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 100323, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 2, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 1, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.021946284, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.008600755, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.007678012, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.003665320, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 163, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.007226270, 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000044332 2024-04-25T15:30:41.885 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 144544, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 100192 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 125, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 160, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 100419, 2024-04-25T15:30:41.886 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 3, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.009160576, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.006591533, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.001408598, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 124, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006230803, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000050248 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.887 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 100288 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 0, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-04-25T15:30:41.888 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-04-25T15:30:41.889 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 148967, 2024-04-25T15:30:41.890 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 29, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-04-25T15:30:41.891 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 928, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 2, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 165, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 121380, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 165, 2024-04-25T15:30:41.892 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 165, 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 121380, 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-25T15:30:41.893 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T15:30:41.897 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2024-04-25T15:30:41.897 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T15:30:41.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T15:30:41.907 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:30:42.086 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.085+0000 7fa777fff640 1 Processor -- start 2024-04-25T15:30:42.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.086+0000 7fa777fff640 1 -- start start 2024-04-25T15:30:42.088 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.087+0000 7fa777fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa770039830 0x7fa770037b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.088+0000 7fa777fff640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7700c9070 con 0x7fa770035410 2024-04-25T15:30:42.089 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.088+0000 7fa7777fe640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa770035410 0x7fa7700d3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43614/0 (socket says 172.21.15.33:43614) 2024-04-25T15:30:42.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.088+0000 7fa7777fe640 1 -- 172.21.15.33:0/3788484255 learned_addr learned my addr 172.21.15.33:0/3788484255 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:42.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.088+0000 7fa776ffd640 1 --2- 172.21.15.33:0/3788484255 >> v2:172.21.15.155:3300/0 conn(0x7fa770039830 0x7fa770037b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.088+0000 7fa777fff640 1 -- 172.21.15.33:0/3788484255 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7700c9350 con 0x7fa770035000 2024-04-25T15:30:42.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.088+0000 7fa777fff640 1 -- 172.21.15.33:0/3788484255 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa7700380c0 con 0x7fa770039830 2024-04-25T15:30:42.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 821986762 0 0) 0x7fa7700c9070 con 0x7fa770035410 2024-04-25T15:30:42.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa760003420 con 0x7fa770035410 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1913558954 0 0) 0x7fa760003420 con 0x7fa770035410 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 >> v2:172.21.15.155:3300/0 conn(0x7fa770039830 msgr2=0x7fa770037b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 --2- 172.21.15.33:0/3788484255 >> v2:172.21.15.155:3300/0 conn(0x7fa770039830 0x7fa770037b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 >> v1:172.21.15.155:6789/0 conn(0x7fa770035000 legacy=0x7fa7700c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7700c9630 con 0x7fa770035410 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7fa778076c00 con 0x7fa770035410 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.089+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 >> v1:172.21.15.33:6789/0 conn(0x7fa770035410 legacy=0x7fa7700d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa775ffb640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa760004a90 0x7fa760004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa775ffb640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7600036a0 0x7fa760003af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa775ffb640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa76000db60 0x7fa76000ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa760010650 con 0x7fa76000db60 2024-04-25T15:30:42.092 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa7600107d0 con 0x7fa7600036a0 2024-04-25T15:30:42.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa7600109d0 con 0x7fa760004a90 2024-04-25T15:30:42.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa7777fe640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa76000db60 0x7fa76000ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa7777fe640 1 -- 172.21.15.33:0/3788484255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa760004a90 msgr2=0x7fa760004ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:30:42.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa7777fe640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa760004a90 0x7fa760004ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa7777fe640 1 -- 172.21.15.33:0/3788484255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7600036a0 msgr2=0x7fa760003af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T15:30:42.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa7777fe640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7600036a0 0x7fa760003af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.093 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.090+0000 7fa7777fe640 1 -- 172.21.15.33:0/3788484255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa760003420 con 0x7fa76000db60 2024-04-25T15:30:42.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.091+0000 7fa7777fe640 1 -- 172.21.15.33:0/3788484255 reap_dead start 2024-04-25T15:30:42.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.092+0000 7fa7777fe640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa76000db60 0x7fa76000ff80 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fa7780514f0 tx=0x7fa760004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ea9c1b31b5b377 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:42.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.092+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77806a1a0 con 0x7fa76000db60 2024-04-25T15:30:42.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.092+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77806e330 con 0x7fa76000db60 2024-04-25T15:30:42.094 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.092+0000 7fa775ffb640 1 -- 172.21.15.33:0/3788484255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77806c7c0 con 0x7fa76000db60 2024-04-25T15:30:42.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.094+0000 7fa777fff640 1 -- 172.21.15.33:0/3788484255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa76000db60 msgr2=0x7fa76000ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.094+0000 7fa777fff640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa76000db60 0x7fa76000ff80 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7fa7780514f0 tx=0x7fa760004720 comp rx=0 tx=0).stop 2024-04-25T15:30:42.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.094+0000 7fa777fff640 1 -- 172.21.15.33:0/3788484255 shutdown_connections 2024-04-25T15:30:42.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.094+0000 7fa777fff640 1 --2- 172.21.15.33:0/3788484255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa76000db60 0x7fa76000ff80 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.095 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.094+0000 7fa777fff640 1 -- 172.21.15.33:0/3788484255 >> 172.21.15.33:0/3788484255 conn(0x7fa770006240 msgr2=0x7fa770006650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:42.097 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.096+0000 7fa777fff640 1 -- 172.21.15.33:0/3788484255 shutdown_connections 2024-04-25T15:30:42.099 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.097+0000 7fa777fff640 1 -- 172.21.15.33:0/3788484255 wait complete. 2024-04-25T15:30:42.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.100+0000 7fa777fff640 1 Processor -- start 2024-04-25T15:30:42.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.100+0000 7fa777fff640 1 -- start start 2024-04-25T15:30:42.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.102+0000 7fa777fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa76000db60 0x7fa7700be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.102+0000 7fa777fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7700bf4f0 0x7fa770166d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.102+0000 7fa777fff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa770169f50 0x7fa77016a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.103 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.102+0000 7fa776ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa76000db60 0x7fa7700be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.102+0000 7fa776ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa76000db60 0x7fa7700be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:38872/0 (socket says 172.21.15.33:38872) 2024-04-25T15:30:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.102+0000 7fa7767fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7700bf4f0 0x7fa770166d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.103+0000 7fa7767fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7700bf4f0 0x7fa770166d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:56638/0 (socket says 172.21.15.33:56638) 2024-04-25T15:30:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.103+0000 7fa7777fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa770169f50 0x7fa77016a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.103+0000 7fa7777fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa770169f50 0x7fa77016a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45394/0 (socket says 172.21.15.33:45394) 2024-04-25T15:30:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.103+0000 7fa776ffd640 1 -- 172.21.15.33:0/231206965 learned_addr learned my addr 172.21.15.33:0/231206965 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.103+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa7700c9b50 con 0x7fa770169f50 2024-04-25T15:30:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.103+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa770039c40 con 0x7fa7700bf4f0 2024-04-25T15:30:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.103+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa7700c8c00 con 0x7fa76000db60 2024-04-25T15:30:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.106+0000 7fa7777fe640 1 -- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa76000db60 msgr2=0x7fa7700be1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.106+0000 7fa7777fe640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa76000db60 0x7fa7700be1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.106+0000 7fa7777fe640 1 -- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7700bf4f0 msgr2=0x7fa770166d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.106+0000 7fa7777fe640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7700bf4f0 0x7fa770166d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.106+0000 7fa7777fe640 1 -- 172.21.15.33:0/231206965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7700bd4b0 con 0x7fa770169f50 2024-04-25T15:30:42.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.106+0000 7fa7777fe640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa770169f50 0x7fa77016a360 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fa77806ba60 tx=0x7fa7700c9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:42.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.107+0000 7fa75f7fe640 1 -- 172.21.15.33:0/231206965 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77806a1a0 con 0x7fa770169f50 2024-04-25T15:30:42.108 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.107+0000 7fa75f7fe640 1 -- 172.21.15.33:0/231206965 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa778076c00 con 0x7fa770169f50 2024-04-25T15:30:42.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.108+0000 7fa75f7fe640 1 -- 172.21.15.33:0/231206965 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77806cb00 con 0x7fa770169f50 2024-04-25T15:30:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.108+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa770167270 con 0x7fa770169f50 2024-04-25T15:30:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.109+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7700bffd0 con 0x7fa770169f50 2024-04-25T15:30:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.110+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa770005540 con 0x7fa770169f50 2024-04-25T15:30:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.113+0000 7fa75f7fe640 1 -- 172.21.15.33:0/231206965 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa77806cca0 con 0x7fa770169f50 2024-04-25T15:30:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.114+0000 7fa75f7fe640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa764074580 0x7fa764076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.114+0000 7fa776ffd640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa764074580 0x7fa764076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.114+0000 7fa75f7fe640 1 -- 172.21.15.33:0/231206965 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7fa778050cb0 con 0x7fa770169f50 2024-04-25T15:30:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.120+0000 7fa776ffd640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa764074580 0x7fa764076a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa768006fd0 tx=0x7fa76800c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.124+0000 7fa75f7fe640 1 -- 172.21.15.33:0/231206965 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa7780be060 con 0x7fa770169f50 2024-04-25T15:30:42.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.484+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7700be700 con 0x7fa764074580 2024-04-25T15:30:42.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.496+0000 7fa75f7fe640 1 -- 172.21.15.33:0/231206965 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258476 (secure 0 0 0) 0x7fa7700be700 con 0x7fa764074580 2024-04-25T15:30:42.497 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:30:42.501 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa764074580 msgr2=0x7fa764076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa764074580 0x7fa764076a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa768006fd0 tx=0x7fa76800c040 comp rx=0 tx=0).stop 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa770169f50 msgr2=0x7fa77016a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa770169f50 0x7fa77016a360 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7fa77806ba60 tx=0x7fa7700c9800 comp rx=0 tx=0).stop 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 shutdown_connections 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa764074580 0x7fa764076a90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa770169f50 0x7fa77016a360 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7700bf4f0 0x7fa770166d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 --2- 172.21.15.33:0/231206965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa76000db60 0x7fa7700be1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.501+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 >> 172.21.15.33:0/231206965 conn(0x7fa770006240 msgr2=0x7fa7700c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:42.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.504+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 shutdown_connections 2024-04-25T15:30:42.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.504+0000 7fa777fff640 1 -- 172.21.15.33:0/231206965 wait complete. 2024-04-25T15:30:42.523 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-04-25T15:30:41.848948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":266518377,"num_objects":20736,"num_object_clones":10299,"num_object_copies":41472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20736,"num_whiteouts":9706,"num_read":945,"num_read_kb":3515,"num_write":168935,"num_write_kb":625333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292145,"ondisk_log_size":292145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2926772,"kb_used_data":613148,"kb_used_omap":12,"kb_used_meta":2313523,"kb_avail":752047948,"statfs":{"total":773094113280,"available":770097098752,"internally_reserved":0,"allocated":627863552,"data_stored":534685452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":2369048114},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,7,9,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-147898,"num_objects":-24870,"num_object_clones":-19457,"num_object_copies":-49740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24870,"num_whiteouts":-5413,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.256374"},"pg_stats":[{"pgid":"3.3f","version":"41'2829","reported_seq":2323,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.717491+0000","last_change":"2024-04-25T15:30:37.717537+0000","last_active":"2024-04-25T15:30:37.717491+0000","last_peered":"2024-04-25T15:30:37.717491+0000","last_clean":"2024-04-25T15:30:37.717491+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:30:37.717491+0000","last_undegraded":"2024-04-25T15:30:37.717491+0000","last_fullsized":"2024-04-25T15:30:37.717491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:24.611556+0000","scrub_duration":0,"objects_trimmed":224,"snaptrim_duration":7.1170097969999997,"stat_sum":{"num_bytes":2448,"num_objects":410,"num_object_clones":204,"num_object_copies":820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3e","version":"41'2630","reported_seq":2112,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.161216+0000","last_change":"2024-04-25T15:30:37.161265+0000","last_active":"2024-04-25T15:30:37.161216+0000","last_peered":"2024-04-25T15:30:37.161216+0000","last_clean":"2024-04-25T15:30:37.161216+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:30:37.161216+0000","last_undegraded":"2024-04-25T15:30:37.161216+0000","last_fullsized":"2024-04-25T15:30:37.161216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2630,"log_dups_size":0,"ondisk_log_size":2630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:52.269365+0000","scrub_duration":0,"objects_trimmed":224,"snaptrim_duration":6.5598153510000001,"stat_sum":{"num_bytes":2472,"num_objects":412,"num_object_clones":206,"num_object_copies":824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":412,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3d","version":"41'3137","reported_seq":2548,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.882826+0000","last_change":"2024-04-25T15:30:37.882872+0000","last_active":"2024-04-25T15:30:37.882826+0000","last_peered":"2024-04-25T15:30:37.882826+0000","last_clean":"2024-04-25T15:30:37.882826+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:30:37.882826+0000","last_undegraded":"2024-04-25T15:30:37.882826+0000","last_fullsized":"2024-04-25T15:30:37.882826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:14.294299+0000","scrub_duration":0,"objects_trimmed":237,"snaptrim_duration":7.2888411399999997,"stat_sum":{"num_bytes":6820,"num_objects":458,"num_object_clones":227,"num_object_copies":916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":458,"num_whiteouts":227,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3c","version":"41'3136","reported_seq":2496,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.803853+0000","last_change":"2024-04-25T15:30:39.688349+0000","last_active":"2024-04-25T15:30:39.803853+0000","last_peered":"2024-04-25T15:30:39.803853+0000","last_clean":"2024-04-25T15:30:39.803853+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:30:39.803853+0000","last_undegraded":"2024-04-25T15:30:39.803853+0000","last_fullsized":"2024-04-25T15:30:39.803853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3136,"log_dups_size":0,"ondisk_log_size":3136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.556786+0000","scrub_duration":0,"objects_trimmed":312,"snaptrim_duration":4.1254658519999996,"stat_sum":{"num_bytes":10939,"num_objects":462,"num_object_clones":228,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":462,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3b","version":"41'3146","reported_seq":2504,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.714065+0000","last_change":"2024-04-25T15:30:36.290986+0000","last_active":"2024-04-25T15:30:36.714065+0000","last_peered":"2024-04-25T15:30:36.714065+0000","last_clean":"2024-04-25T15:30:36.714065+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:30:36.714065+0000","last_undegraded":"2024-04-25T15:30:36.714065+0000","last_fullsized":"2024-04-25T15:30:36.714065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3146,"log_dups_size":0,"ondisk_log_size":3146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:42.248138+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":5.6918965269999999,"stat_sum":{"num_bytes":6976,"num_objects":481,"num_object_clones":240,"num_object_copies":962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3a","version":"41'3483","reported_seq":2770,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.701126+0000","last_change":"2024-04-25T15:30:38.703165+0000","last_active":"2024-04-25T15:30:38.701126+0000","last_peered":"2024-04-25T15:30:38.701126+0000","last_clean":"2024-04-25T15:30:38.701126+0000","last_became_active":"2024-04-25T15:21:23.754462+0000","last_became_peered":"2024-04-25T15:21:23.754462+0000","last_unstale":"2024-04-25T15:30:38.701126+0000","last_undegraded":"2024-04-25T15:30:38.701126+0000","last_fullsized":"2024-04-25T15:30:38.701126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3483,"log_dups_size":0,"ondisk_log_size":3483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:36.167106+0000","scrub_duration":0,"objects_trimmed":689,"snaptrim_duration":8.0917395699999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.39","version":"41'2960","reported_seq":2399,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.826398+0000","last_change":"2024-04-25T15:30:39.508551+0000","last_active":"2024-04-25T15:30:39.826398+0000","last_peered":"2024-04-25T15:30:39.826398+0000","last_clean":"2024-04-25T15:30:39.826398+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:30:39.826398+0000","last_undegraded":"2024-04-25T15:30:39.826398+0000","last_fullsized":"2024-04-25T15:30:39.826398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2960,"log_dups_size":0,"ondisk_log_size":2960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:13.096251+0000","scrub_duration":0,"objects_trimmed":355,"snaptrim_duration":2.4448173,"stat_sum":{"num_bytes":6152,"num_objects":330,"num_object_clones":164,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":330,"num_whiteouts":163,"num_read":1,"num_read_kb":0,"num_write":1188,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.38","version":"41'2720","reported_seq":2196,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.856018+0000","last_change":"2024-04-25T15:30:32.858743+0000","last_active":"2024-04-25T15:30:36.856018+0000","last_peered":"2024-04-25T15:30:36.856018+0000","last_clean":"2024-04-25T15:30:36.856018+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:30:36.856018+0000","last_undegraded":"2024-04-25T15:30:36.856018+0000","last_fullsized":"2024-04-25T15:30:36.856018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2720,"log_dups_size":0,"ondisk_log_size":2720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:39.840877+0000","scrub_duration":0,"objects_trimmed":237,"snaptrim_duration":2.2674431460000002,"stat_sum":{"num_bytes":6724,"num_objects":439,"num_object_clones":219,"num_object_copies":878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":219,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.37","version":"41'3084","reported_seq":2514,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.877805+0000","last_change":"2024-04-25T15:30:38.877851+0000","last_active":"2024-04-25T15:30:38.877805+0000","last_peered":"2024-04-25T15:30:38.877805+0000","last_clean":"2024-04-25T15:30:38.877805+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:30:38.877805+0000","last_undegraded":"2024-04-25T15:30:38.877805+0000","last_fullsized":"2024-04-25T15:30:38.877805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:34.457672+0000","scrub_duration":0,"objects_trimmed":251,"snaptrim_duration":8.2771185579999997,"stat_sum":{"num_bytes":2748,"num_objects":460,"num_object_clones":229,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":460,"num_whiteouts":229,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.36","version":"41'3421","reported_seq":2816,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.170307+0000","last_change":"2024-04-25T15:30:37.170350+0000","last_active":"2024-04-25T15:30:37.170307+0000","last_peered":"2024-04-25T15:30:37.170307+0000","last_clean":"2024-04-25T15:30:37.170307+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:30:37.170307+0000","last_undegraded":"2024-04-25T15:30:37.170307+0000","last_fullsized":"2024-04-25T15:30:37.170307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:26.387482+0000","scrub_duration":0,"objects_trimmed":653,"snaptrim_duration":6.5677128429999998,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.35","version":"41'3365","reported_seq":2707,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.723622+0000","last_change":"2024-04-25T15:30:36.328180+0000","last_active":"2024-04-25T15:30:36.723622+0000","last_peered":"2024-04-25T15:30:36.723622+0000","last_clean":"2024-04-25T15:30:36.723622+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:30:36.723622+0000","last_undegraded":"2024-04-25T15:30:36.723622+0000","last_fullsized":"2024-04-25T15:30:36.723622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:20.257648+0000","scrub_duration":0,"objects_trimmed":691,"snaptrim_duration":5.7256742149999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.34","version":"41'3667","reported_seq":2916,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.675536+0000","last_change":"2024-04-25T15:30:38.675909+0000","last_active":"2024-04-25T15:30:38.675536+0000","last_peered":"2024-04-25T15:30:38.675536+0000","last_clean":"2024-04-25T15:30:38.675536+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:30:38.675536+0000","last_undegraded":"2024-04-25T15:30:38.675536+0000","last_fullsized":"2024-04-25T15:30:38.675536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:10.365408+0000","scrub_duration":0,"objects_trimmed":759,"snaptrim_duration":8.0780853560000008,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.33","version":"41'2832","reported_seq":2321,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.529493+0000","last_change":"2024-04-25T15:30:37.529542+0000","last_active":"2024-04-25T15:30:37.529493+0000","last_peered":"2024-04-25T15:30:37.529493+0000","last_clean":"2024-04-25T15:30:37.529493+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:30:37.529493+0000","last_undegraded":"2024-04-25T15:30:37.529493+0000","last_fullsized":"2024-04-25T15:30:37.529493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:18.828740+0000","scrub_duration":0,"objects_trimmed":225,"snaptrim_duration":6.9396563239999995,"stat_sum":{"num_bytes":6660,"num_objects":425,"num_object_clones":211,"num_object_copies":850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":425,"num_whiteouts":211,"num_read":1,"num_read_kb":0,"num_write":1152,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.32","version":"41'2851","reported_seq":2296,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.820687+0000","last_change":"2024-04-25T15:30:35.695421+0000","last_active":"2024-04-25T15:30:36.820687+0000","last_peered":"2024-04-25T15:30:36.820687+0000","last_clean":"2024-04-25T15:30:36.820687+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:30:36.820687+0000","last_undegraded":"2024-04-25T15:30:36.820687+0000","last_fullsized":"2024-04-25T15:30:36.820687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:32.390382+0000","scrub_duration":0,"objects_trimmed":254,"snaptrim_duration":5.1020456789999997,"stat_sum":{"num_bytes":2772,"num_objects":464,"num_object_clones":232,"num_object_copies":928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":464,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.31","version":"41'3614","reported_seq":2868,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.818073+0000","last_change":"2024-04-25T15:30:37.608682+0000","last_active":"2024-04-25T15:30:39.818073+0000","last_peered":"2024-04-25T15:30:39.818073+0000","last_clean":"2024-04-25T15:30:39.818073+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:30:39.818073+0000","last_undegraded":"2024-04-25T15:30:39.818073+0000","last_fullsized":"2024-04-25T15:30:39.818073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.286828+0000","scrub_duration":0,"objects_trimmed":718,"snaptrim_duration":3.3798137829999999,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.30","version":"41'3345","reported_seq":2704,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.805396+0000","last_change":"2024-04-25T15:30:39.550459+0000","last_active":"2024-04-25T15:30:39.805396+0000","last_peered":"2024-04-25T15:30:39.805396+0000","last_clean":"2024-04-25T15:30:39.805396+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:30:39.805396+0000","last_undegraded":"2024-04-25T15:30:39.805396+0000","last_fullsized":"2024-04-25T15:30:39.805396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3345,"log_dups_size":0,"ondisk_log_size":3345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:14.294299+0000","scrub_duration":0,"objects_trimmed":309,"snaptrim_duration":3.23396032,"stat_sum":{"num_bytes":2340,"num_objects":395,"num_object_clones":196,"num_object_copies":790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":196,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2f","version":"41'3039","reported_seq":2454,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.765443+0000","last_change":"2024-04-25T15:30:35.194447+0000","last_active":"2024-04-25T15:30:36.765443+0000","last_peered":"2024-04-25T15:30:36.765443+0000","last_clean":"2024-04-25T15:30:36.765443+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:30:36.765443+0000","last_undegraded":"2024-04-25T15:30:36.765443+0000","last_fullsized":"2024-04-25T15:30:36.765443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3039,"log_dups_size":0,"ondisk_log_size":3039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:25.180751+0000","scrub_duration":0,"objects_trimmed":267,"snaptrim_duration":4.6003804729999995,"stat_sum":{"num_bytes":7115,"num_objects":503,"num_object_clones":250,"num_object_copies":1006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":503,"num_whiteouts":249,"num_read":29,"num_read_kb":23,"num_write":1332,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2e","version":"41'3381","reported_seq":2767,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.293789+0000","last_change":"2024-04-25T15:30:37.294444+0000","last_active":"2024-04-25T15:30:37.293789+0000","last_peered":"2024-04-25T15:30:37.293789+0000","last_clean":"2024-04-25T15:30:37.293789+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:30:37.293789+0000","last_undegraded":"2024-04-25T15:30:37.293789+0000","last_fullsized":"2024-04-25T15:30:37.293789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3381,"log_dups_size":0,"ondisk_log_size":3381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:39.283655+0000","scrub_duration":0,"objects_trimmed":607,"snaptrim_duration":6.6868273169999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1074,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.2d","version":"41'2935","reported_seq":2377,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.769129+0000","last_change":"2024-04-25T15:30:34.823111+0000","last_active":"2024-04-25T15:30:36.769129+0000","last_peered":"2024-04-25T15:30:36.769129+0000","last_clean":"2024-04-25T15:30:36.769129+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:30:36.769129+0000","last_undegraded":"2024-04-25T15:30:36.769129+0000","last_fullsized":"2024-04-25T15:30:36.769129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":0,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.008764+0000","scrub_duration":0,"objects_trimmed":241,"snaptrim_duration":4.2245572769999997,"stat_sum":{"num_bytes":10796,"num_objects":437,"num_object_clones":217,"num_object_copies":874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":437,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2c","version":"41'3637","reported_seq":2956,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.782864+0000","last_change":"2024-04-25T15:30:38.584170+0000","last_active":"2024-04-25T15:30:39.782864+0000","last_peered":"2024-04-25T15:30:39.782864+0000","last_clean":"2024-04-25T15:30:39.782864+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:30:39.782864+0000","last_undegraded":"2024-04-25T15:30:39.782864+0000","last_fullsized":"2024-04-25T15:30:39.782864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3637,"log_dups_size":0,"ondisk_log_size":3637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.188818+0000","scrub_duration":0,"objects_trimmed":675,"snaptrim_duration":4.527686181,"stat_sum":{"num_bytes":4381,"num_objects":48,"num_object_clones":23,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":23,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2b","version":"41'2589","reported_seq":2125,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.840738+0000","last_change":"2024-04-25T15:30:39.261980+0000","last_active":"2024-04-25T15:30:39.840738+0000","last_peered":"2024-04-25T15:30:39.840738+0000","last_clean":"2024-04-25T15:30:39.840738+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:30:39.840738+0000","last_undegraded":"2024-04-25T15:30:39.840738+0000","last_fullsized":"2024-04-25T15:30:39.840738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2589,"log_dups_size":0,"ondisk_log_size":2589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:25.180751+0000","scrub_duration":0,"objects_trimmed":93,"snaptrim_duration":2.5085498839999998,"stat_sum":{"num_bytes":12295,"num_objects":576,"num_object_clones":353,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":576,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"41'3477","reported_seq":2811,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.369522+0000","last_change":"2024-04-25T15:30:38.369568+0000","last_active":"2024-04-25T15:30:38.369522+0000","last_peered":"2024-04-25T15:30:38.369522+0000","last_clean":"2024-04-25T15:30:38.369522+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:30:38.369522+0000","last_undegraded":"2024-04-25T15:30:38.369522+0000","last_fullsized":"2024-04-25T15:30:38.369522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3477,"log_dups_size":0,"ondisk_log_size":3477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:38.889747+0000","scrub_duration":0,"objects_trimmed":279,"snaptrim_duration":7.7756122369999998,"stat_sum":{"num_bytes":2988,"num_objects":499,"num_object_clones":249,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":249,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.29","version":"41'2839","reported_seq":2307,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.771891+0000","last_change":"2024-04-25T15:30:38.771953+0000","last_active":"2024-04-25T15:30:38.771891+0000","last_peered":"2024-04-25T15:30:38.771891+0000","last_clean":"2024-04-25T15:30:38.771891+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:30:38.771891+0000","last_undegraded":"2024-04-25T15:30:38.771891+0000","last_fullsized":"2024-04-25T15:30:38.771891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:19.962755+0000","scrub_duration":0,"objects_trimmed":234,"snaptrim_duration":8.1826379809999992,"stat_sum":{"num_bytes":2688,"num_objects":448,"num_object_clones":224,"num_object_copies":896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":448,"num_whiteouts":224,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.28","version":"41'3870","reported_seq":3072,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.688276+0000","last_change":"2024-04-25T15:30:39.688338+0000","last_active":"2024-04-25T15:30:39.688276+0000","last_peered":"2024-04-25T15:30:39.688276+0000","last_clean":"2024-04-25T15:30:39.688276+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:30:39.688276+0000","last_undegraded":"2024-04-25T15:30:39.688276+0000","last_fullsized":"2024-04-25T15:30:39.688276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:50.436650+0000","scrub_duration":0,"objects_trimmed":736,"snaptrim_duration":9.0947790669999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.27","version":"41'2706","reported_seq":2190,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.756049+0000","last_change":"2024-04-25T15:30:34.264406+0000","last_active":"2024-04-25T15:30:36.756049+0000","last_peered":"2024-04-25T15:30:36.756049+0000","last_clean":"2024-04-25T15:30:36.756049+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:30:36.756049+0000","last_undegraded":"2024-04-25T15:30:36.756049+0000","last_fullsized":"2024-04-25T15:30:36.756049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2706,"log_dups_size":0,"ondisk_log_size":2706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:12.255072+0000","scrub_duration":0,"objects_trimmed":221,"snaptrim_duration":3.675183461,"stat_sum":{"num_bytes":2508,"num_objects":420,"num_object_clones":210,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":210,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.26","version":"41'3511","reported_seq":2842,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.082124+0000","last_change":"2024-04-25T15:30:39.082167+0000","last_active":"2024-04-25T15:30:39.082124+0000","last_peered":"2024-04-25T15:30:39.082124+0000","last_clean":"2024-04-25T15:30:39.082124+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:30:39.082124+0000","last_undegraded":"2024-04-25T15:30:39.082124+0000","last_fullsized":"2024-04-25T15:30:39.082124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:34.715196+0000","scrub_duration":0,"objects_trimmed":665,"snaptrim_duration":8.4792293389999998,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.25","version":"41'3084","reported_seq":2454,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.813596+0000","last_change":"2024-04-25T15:30:35.728684+0000","last_active":"2024-04-25T15:30:36.813596+0000","last_peered":"2024-04-25T15:30:36.813596+0000","last_clean":"2024-04-25T15:30:36.813596+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:30:36.813596+0000","last_undegraded":"2024-04-25T15:30:36.813596+0000","last_fullsized":"2024-04-25T15:30:36.813596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:34.715196+0000","scrub_duration":0,"objects_trimmed":236,"snaptrim_duration":5.1279696599999998,"stat_sum":{"num_bytes":6736,"num_objects":442,"num_object_clones":220,"num_object_copies":884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.24","version":"41'2870","reported_seq":2298,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.400954+0000","last_change":"2024-04-25T15:30:39.401000+0000","last_active":"2024-04-25T15:30:39.400954+0000","last_peered":"2024-04-25T15:30:39.400954+0000","last_clean":"2024-04-25T15:30:39.400954+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:30:39.400954+0000","last_undegraded":"2024-04-25T15:30:39.400954+0000","last_fullsized":"2024-04-25T15:30:39.400954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2870,"log_dups_size":0,"ondisk_log_size":2870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:42.101503+0000","scrub_duration":0,"objects_trimmed":228,"snaptrim_duration":8.8116670890000002,"stat_sum":{"num_bytes":2568,"num_objects":429,"num_object_clones":214,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":429,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.23","version":"41'2974","reported_seq":2391,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.089089+0000","last_change":"2024-04-25T15:30:38.089128+0000","last_active":"2024-04-25T15:30:38.089089+0000","last_peered":"2024-04-25T15:30:38.089089+0000","last_clean":"2024-04-25T15:30:38.089089+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:30:38.089089+0000","last_undegraded":"2024-04-25T15:30:38.089089+0000","last_fullsized":"2024-04-25T15:30:38.089089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2974,"log_dups_size":0,"ondisk_log_size":2974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:08.750880+0000","scrub_duration":0,"objects_trimmed":255,"snaptrim_duration":7.4951841339999996,"stat_sum":{"num_bytes":6940,"num_objects":475,"num_object_clones":237,"num_object_copies":950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":237,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.22","version":"41'3138","reported_seq":2509,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.299277+0000","last_change":"2024-04-25T15:30:37.300211+0000","last_active":"2024-04-25T15:30:37.299277+0000","last_peered":"2024-04-25T15:30:37.299277+0000","last_clean":"2024-04-25T15:30:37.299277+0000","last_became_active":"2024-04-25T15:21:23.859850+0000","last_became_peered":"2024-04-25T15:21:23.859850+0000","last_unstale":"2024-04-25T15:30:37.299277+0000","last_undegraded":"2024-04-25T15:30:37.299277+0000","last_fullsized":"2024-04-25T15:30:37.299277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3138,"log_dups_size":0,"ondisk_log_size":3138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:29:49.950843+0000","scrub_duration":0,"objects_trimmed":606,"snaptrim_duration":6.6890380110000001,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.21","version":"41'4292","reported_seq":3407,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.296102+0000","last_change":"2024-04-25T15:30:37.296764+0000","last_active":"2024-04-25T15:30:37.296102+0000","last_peered":"2024-04-25T15:30:37.296102+0000","last_clean":"2024-04-25T15:30:37.296102+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:30:37.296102+0000","last_undegraded":"2024-04-25T15:30:37.296102+0000","last_fullsized":"2024-04-25T15:30:37.296102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":4292,"log_dups_size":0,"ondisk_log_size":4292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:20.083988+0000","scrub_duration":0,"objects_trimmed":828,"snaptrim_duration":6.6887649839999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1392,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.20","version":"41'3875","reported_seq":3100,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.584094+0000","last_change":"2024-04-25T15:30:38.584137+0000","last_active":"2024-04-25T15:30:38.584094+0000","last_peered":"2024-04-25T15:30:38.584094+0000","last_clean":"2024-04-25T15:30:38.584094+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:30:38.584094+0000","last_undegraded":"2024-04-25T15:30:38.584094+0000","last_fullsized":"2024-04-25T15:30:38.584094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3875,"log_dups_size":0,"ondisk_log_size":3875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:27.011814+0000","scrub_duration":0,"objects_trimmed":743,"snaptrim_duration":7.9821429300000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.1a","version":"41'3757","reported_seq":2998,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676006+0000","last_change":"2024-04-25T15:30:38.676214+0000","last_active":"2024-04-25T15:30:38.676006+0000","last_peered":"2024-04-25T15:30:38.676006+0000","last_clean":"2024-04-25T15:30:38.676006+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:30:38.676006+0000","last_undegraded":"2024-04-25T15:30:38.676006+0000","last_fullsized":"2024-04-25T15:30:38.676006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:32.184227+0000","scrub_duration":0,"objects_trimmed":718,"snaptrim_duration":8.0786759789999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.1b","version":"40'3208","reported_seq":3267,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589972+0000","last_change":"2024-04-25T15:20:41.411834+0000","last_active":"2024-04-25T15:30:30.589972+0000","last_peered":"2024-04-25T15:30:30.589972+0000","last_clean":"2024-04-25T15:30:30.589972+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:30:30.589972+0000","last_undegraded":"2024-04-25T15:30:30.589972+0000","last_fullsized":"2024-04-25T15:30:30.589972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":3284,"num_write_kb":9502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"41'2975","reported_seq":2406,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.797633+0000","last_change":"2024-04-25T15:30:39.797773+0000","last_active":"2024-04-25T15:30:39.797633+0000","last_peered":"2024-04-25T15:30:39.797633+0000","last_clean":"2024-04-25T15:30:39.797633+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:30:39.797633+0000","last_undegraded":"2024-04-25T15:30:39.797633+0000","last_fullsized":"2024-04-25T15:30:39.797633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2975,"log_dups_size":0,"ondisk_log_size":2975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:50.436650+0000","scrub_duration":0,"objects_trimmed":257,"snaptrim_duration":9.2035530340000005,"stat_sum":{"num_bytes":2940,"num_objects":491,"num_object_clones":245,"num_object_copies":982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":491,"num_whiteouts":245,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1a","version":"40'6006","reported_seq":6065,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602379+0000","last_change":"2024-04-25T15:20:41.401581+0000","last_active":"2024-04-25T15:30:30.602379+0000","last_peered":"2024-04-25T15:30:30.602379+0000","last_clean":"2024-04-25T15:30:30.602379+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:30:30.602379+0000","last_undegraded":"2024-04-25T15:30:30.602379+0000","last_fullsized":"2024-04-25T15:30:30.602379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6006,"log_dups_size":0,"ondisk_log_size":6006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":6066,"num_write_kb":31066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"40'881","reported_seq":941,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589144+0000","last_change":"2024-04-25T15:20:41.404692+0000","last_active":"2024-04-25T15:30:30.589144+0000","last_peered":"2024-04-25T15:30:30.589144+0000","last_clean":"2024-04-25T15:30:30.589144+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:30:30.589144+0000","last_undegraded":"2024-04-25T15:30:30.589144+0000","last_fullsized":"2024-04-25T15:30:30.589144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":944,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"41'3300","reported_seq":2631,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.856467+0000","last_change":"2024-04-25T15:30:34.747823+0000","last_active":"2024-04-25T15:30:36.856467+0000","last_peered":"2024-04-25T15:30:36.856467+0000","last_clean":"2024-04-25T15:30:36.856467+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:30:36.856467+0000","last_undegraded":"2024-04-25T15:30:36.856467+0000","last_fullsized":"2024-04-25T15:30:36.856467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:35.107011+0000","scrub_duration":0,"objects_trimmed":282,"snaptrim_duration":4.1586895349999997,"stat_sum":{"num_bytes":3227,"num_objects":540,"num_object_clones":269,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":269,"num_read":0,"num_read_kb":0,"num_write":1372,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.18","version":"40'3115","reported_seq":3175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593773+0000","last_change":"2024-04-25T15:20:41.406208+0000","last_active":"2024-04-25T15:30:30.593773+0000","last_peered":"2024-04-25T15:30:30.593773+0000","last_clean":"2024-04-25T15:30:30.593773+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:30:30.593773+0000","last_undegraded":"2024-04-25T15:30:30.593773+0000","last_fullsized":"2024-04-25T15:30:30.593773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3115,"log_dups_size":0,"ondisk_log_size":3115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3188,"num_write_kb":38703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"41'3651","reported_seq":2949,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.749771+0000","last_change":"2024-04-25T15:30:38.749822+0000","last_active":"2024-04-25T15:30:38.749771+0000","last_peered":"2024-04-25T15:30:38.749771+0000","last_clean":"2024-04-25T15:30:38.749771+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:30:38.749771+0000","last_undegraded":"2024-04-25T15:30:38.749771+0000","last_fullsized":"2024-04-25T15:30:38.749771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3651,"log_dups_size":0,"ondisk_log_size":3651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:27.011814+0000","scrub_duration":0,"objects_trimmed":658,"snaptrim_duration":8.1500825540000008,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.17","version":"40'1109","reported_seq":1169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602496+0000","last_change":"2024-04-25T15:20:41.406067+0000","last_active":"2024-04-25T15:30:30.602496+0000","last_peered":"2024-04-25T15:30:30.602496+0000","last_clean":"2024-04-25T15:30:30.602496+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:30:30.602496+0000","last_undegraded":"2024-04-25T15:30:30.602496+0000","last_fullsized":"2024-04-25T15:30:30.602496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1182,"num_write_kb":13307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"41'2914","reported_seq":2378,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.797642+0000","last_change":"2024-04-25T15:30:35.649216+0000","last_active":"2024-04-25T15:30:36.797642+0000","last_peered":"2024-04-25T15:30:36.797642+0000","last_clean":"2024-04-25T15:30:36.797642+0000","last_became_active":"2024-04-25T15:21:23.536519+0000","last_became_peered":"2024-04-25T15:21:23.536519+0000","last_unstale":"2024-04-25T15:30:36.797642+0000","last_undegraded":"2024-04-25T15:30:36.797642+0000","last_fullsized":"2024-04-25T15:30:36.797642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2914,"log_dups_size":0,"ondisk_log_size":2914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.188818+0000","scrub_duration":0,"objects_trimmed":229,"snaptrim_duration":5.0480612520000001,"stat_sum":{"num_bytes":6676,"num_objects":432,"num_object_clones":215,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":215,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.16","version":"40'1813","reported_seq":1873,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593511+0000","last_change":"2024-04-25T15:20:41.410325+0000","last_active":"2024-04-25T15:30:30.593511+0000","last_peered":"2024-04-25T15:30:30.593511+0000","last_clean":"2024-04-25T15:30:30.593511+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:30:30.593511+0000","last_undegraded":"2024-04-25T15:30:30.593511+0000","last_fullsized":"2024-04-25T15:30:30.593511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1874,"num_write_kb":25731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"41'3084","reported_seq":2484,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.796302+0000","last_change":"2024-04-25T15:30:34.106253+0000","last_active":"2024-04-25T15:30:36.796302+0000","last_peered":"2024-04-25T15:30:36.796302+0000","last_clean":"2024-04-25T15:30:36.796302+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:30:36.796302+0000","last_undegraded":"2024-04-25T15:30:36.796302+0000","last_fullsized":"2024-04-25T15:30:36.796302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:46:23.746310+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":3.513388913,"stat_sum":{"num_bytes":2839,"num_objects":470,"num_object_clones":235,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":234,"num_read":3,"num_read_kb":2,"num_write":1199,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.15","version":"40'3249","reported_seq":3308,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600801+0000","last_change":"2024-04-25T15:20:41.415893+0000","last_active":"2024-04-25T15:30:30.600801+0000","last_peered":"2024-04-25T15:30:30.600801+0000","last_clean":"2024-04-25T15:30:30.600801+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:30:30.600801+0000","last_undegraded":"2024-04-25T15:30:30.600801+0000","last_fullsized":"2024-04-25T15:30:30.600801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3249,"log_dups_size":0,"ondisk_log_size":3249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3319,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'3965","reported_seq":3179,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676280+0000","last_change":"2024-04-25T15:30:38.676764+0000","last_active":"2024-04-25T15:30:38.676280+0000","last_peered":"2024-04-25T15:30:38.676280+0000","last_clean":"2024-04-25T15:30:38.676280+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:30:38.676280+0000","last_undegraded":"2024-04-25T15:30:38.676280+0000","last_fullsized":"2024-04-25T15:30:38.676280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3965,"log_dups_size":0,"ondisk_log_size":3965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:50.458209+0000","scrub_duration":0,"objects_trimmed":757,"snaptrim_duration":8.0786606909999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.14","version":"41'5275","reported_seq":5335,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.604978+0000","last_change":"2024-04-25T15:20:41.406750+0000","last_active":"2024-04-25T15:30:30.604978+0000","last_peered":"2024-04-25T15:30:30.604978+0000","last_clean":"2024-04-25T15:30:30.604978+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:30:30.604978+0000","last_undegraded":"2024-04-25T15:30:30.604978+0000","last_fullsized":"2024-04-25T15:30:30.604978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":5332,"num_write_kb":30677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"41'3520","reported_seq":2810,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.829353+0000","last_change":"2024-04-25T15:30:38.877873+0000","last_active":"2024-04-25T15:30:39.829353+0000","last_peered":"2024-04-25T15:30:39.829353+0000","last_clean":"2024-04-25T15:30:39.829353+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:30:39.829353+0000","last_undegraded":"2024-04-25T15:30:39.829353+0000","last_fullsized":"2024-04-25T15:30:39.829353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:40.123031+0000","scrub_duration":0,"objects_trimmed":598,"snaptrim_duration":1.615482919,"stat_sum":{"num_bytes":696,"num_objects":118,"num_object_clones":59,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":59,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.13","version":"40'2601","reported_seq":2661,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.594170+0000","last_change":"2024-04-25T15:20:41.401705+0000","last_active":"2024-04-25T15:30:30.594170+0000","last_peered":"2024-04-25T15:30:30.594170+0000","last_clean":"2024-04-25T15:30:30.594170+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:30:30.594170+0000","last_undegraded":"2024-04-25T15:30:30.594170+0000","last_fullsized":"2024-04-25T15:30:30.594170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":2688,"num_write_kb":17973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"41'2843","reported_seq":2289,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.820025+0000","last_change":"2024-04-25T15:30:36.212116+0000","last_active":"2024-04-25T15:30:36.820025+0000","last_peered":"2024-04-25T15:30:36.820025+0000","last_clean":"2024-04-25T15:30:36.820025+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:30:36.820025+0000","last_undegraded":"2024-04-25T15:30:36.820025+0000","last_fullsized":"2024-04-25T15:30:36.820025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2843,"log_dups_size":0,"ondisk_log_size":2843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:57.104366+0000","scrub_duration":0,"objects_trimmed":240,"snaptrim_duration":5.6185218160000003,"stat_sum":{"num_bytes":2729,"num_objects":450,"num_object_clones":225,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":224,"num_read":4,"num_read_kb":3,"num_write":1228,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.12","version":"40'111","reported_seq":171,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593646+0000","last_change":"2024-04-25T15:20:41.409212+0000","last_active":"2024-04-25T15:30:30.593646+0000","last_peered":"2024-04-25T15:30:30.593646+0000","last_clean":"2024-04-25T15:30:30.593646+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:30:30.593646+0000","last_undegraded":"2024-04-25T15:30:30.593646+0000","last_fullsized":"2024-04-25T15:30:30.593646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":196,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"41'3627","reported_seq":2962,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.763179+0000","last_change":"2024-04-25T15:30:36.524583+0000","last_active":"2024-04-25T15:30:36.763179+0000","last_peered":"2024-04-25T15:30:36.763179+0000","last_clean":"2024-04-25T15:30:36.763179+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:30:36.763179+0000","last_undegraded":"2024-04-25T15:30:36.763179+0000","last_fullsized":"2024-04-25T15:30:36.763179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:43.450201+0000","scrub_duration":0,"objects_trimmed":264,"snaptrim_duration":5.9252819609999996,"stat_sum":{"num_bytes":2963,"num_objects":495,"num_object_clones":247,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":246,"num_read":0,"num_read_kb":0,"num_write":1302,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.11","version":"40'1074","reported_seq":1134,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602130+0000","last_change":"2024-04-25T15:20:41.402015+0000","last_active":"2024-04-25T15:30:30.602130+0000","last_peered":"2024-04-25T15:30:30.602130+0000","last_clean":"2024-04-25T15:30:30.602130+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:30:30.602130+0000","last_undegraded":"2024-04-25T15:30:30.602130+0000","last_fullsized":"2024-04-25T15:30:30.602130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1158,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"41'3313","reported_seq":2636,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.788145+0000","last_change":"2024-04-25T15:30:39.082197+0000","last_active":"2024-04-25T15:30:39.788145+0000","last_peered":"2024-04-25T15:30:39.788145+0000","last_clean":"2024-04-25T15:30:39.788145+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:30:39.788145+0000","last_undegraded":"2024-04-25T15:30:39.788145+0000","last_fullsized":"2024-04-25T15:30:39.788145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:52.269365+0000","scrub_duration":0,"objects_trimmed":483,"snaptrim_duration":5.3086005309999997,"stat_sum":{"num_bytes":1128,"num_objects":188,"num_object_clones":94,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":94,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.10","version":"40'1015","reported_seq":1074,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.607771+0000","last_change":"2024-04-25T15:20:41.408427+0000","last_active":"2024-04-25T15:30:30.607771+0000","last_peered":"2024-04-25T15:30:30.607771+0000","last_clean":"2024-04-25T15:30:30.607771+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:30:30.607771+0000","last_undegraded":"2024-04-25T15:30:30.607771+0000","last_fullsized":"2024-04-25T15:30:30.607771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1107,"num_write_kb":8933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"41'3012","reported_seq":2410,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.813421+0000","last_change":"2024-04-25T15:30:34.399393+0000","last_active":"2024-04-25T15:30:36.813421+0000","last_peered":"2024-04-25T15:30:36.813421+0000","last_clean":"2024-04-25T15:30:36.813421+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:30:36.813421+0000","last_undegraded":"2024-04-25T15:30:36.813421+0000","last_fullsized":"2024-04-25T15:30:36.813421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3012,"log_dups_size":0,"ondisk_log_size":3012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:38.071652+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":3.8010930269999998,"stat_sum":{"num_bytes":2784,"num_objects":467,"num_object_clones":232,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.f","version":"40'1305","reported_seq":1365,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.597526+0000","last_change":"2024-04-25T15:20:41.405515+0000","last_active":"2024-04-25T15:30:30.597526+0000","last_peered":"2024-04-25T15:30:30.597526+0000","last_clean":"2024-04-25T15:30:30.597526+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:30:30.597526+0000","last_undegraded":"2024-04-25T15:30:30.597526+0000","last_fullsized":"2024-04-25T15:30:30.597526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1305,"log_dups_size":0,"ondisk_log_size":1305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":1351,"num_write_kb":8728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"41'3157","reported_seq":2502,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.076092+0000","last_change":"2024-04-25T15:30:38.076135+0000","last_active":"2024-04-25T15:30:38.076092+0000","last_peered":"2024-04-25T15:30:38.076092+0000","last_clean":"2024-04-25T15:30:38.076092+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:30:38.076092+0000","last_undegraded":"2024-04-25T15:30:38.076092+0000","last_fullsized":"2024-04-25T15:30:38.076092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3157,"log_dups_size":0,"ondisk_log_size":3157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:57.855461+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":7.4762973989999999,"stat_sum":{"num_bytes":2894,"num_objects":483,"num_object_clones":240,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":483,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.e","version":"40'2474","reported_seq":2533,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.607786+0000","last_change":"2024-04-25T15:20:41.406806+0000","last_active":"2024-04-25T15:30:30.607786+0000","last_peered":"2024-04-25T15:30:30.607786+0000","last_clean":"2024-04-25T15:30:30.607786+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:30:30.607786+0000","last_undegraded":"2024-04-25T15:30:30.607786+0000","last_fullsized":"2024-04-25T15:30:30.607786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2474,"log_dups_size":0,"ondisk_log_size":2474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2548,"num_write_kb":13580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"41'2993","reported_seq":2435,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.508105+0000","last_change":"2024-04-25T15:30:39.508145+0000","last_active":"2024-04-25T15:30:39.508105+0000","last_peered":"2024-04-25T15:30:39.508105+0000","last_clean":"2024-04-25T15:30:39.508105+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:30:39.508105+0000","last_undegraded":"2024-04-25T15:30:39.508105+0000","last_fullsized":"2024-04-25T15:30:39.508105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2993,"log_dups_size":0,"ondisk_log_size":2993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:39:13.576915+0000","scrub_duration":0,"objects_trimmed":250,"snaptrim_duration":8.9069907399999995,"stat_sum":{"num_bytes":6889,"num_objects":467,"num_object_clones":232,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":231,"num_read":2,"num_read_kb":1,"num_write":1224,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.d","version":"40'4442","reported_seq":4501,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600901+0000","last_change":"2024-04-25T15:20:41.410562+0000","last_active":"2024-04-25T15:30:30.600901+0000","last_peered":"2024-04-25T15:30:30.600901+0000","last_clean":"2024-04-25T15:30:30.600901+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:30:30.600901+0000","last_undegraded":"2024-04-25T15:30:30.600901+0000","last_fullsized":"2024-04-25T15:30:30.600901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583135,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":4527,"num_write_kb":26836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"41'3079","reported_seq":2481,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.081368+0000","last_change":"2024-04-25T15:30:37.081413+0000","last_active":"2024-04-25T15:30:37.081368+0000","last_peered":"2024-04-25T15:30:37.081368+0000","last_clean":"2024-04-25T15:30:37.081368+0000","last_became_active":"2024-04-25T15:21:23.537569+0000","last_became_peered":"2024-04-25T15:21:23.537569+0000","last_unstale":"2024-04-25T15:30:37.081368+0000","last_undegraded":"2024-04-25T15:30:37.081368+0000","last_fullsized":"2024-04-25T15:30:37.081368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3079,"log_dups_size":0,"ondisk_log_size":3079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:57.114192+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":6.4871342199999997,"stat_sum":{"num_bytes":2760,"num_objects":462,"num_object_clones":230,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":462,"num_whiteouts":230,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.c","version":"40'2074","reported_seq":2133,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.611756+0000","last_change":"2024-04-25T15:20:41.404065+0000","last_active":"2024-04-25T15:30:30.611756+0000","last_peered":"2024-04-25T15:30:30.611756+0000","last_clean":"2024-04-25T15:30:30.611756+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:30:30.611756+0000","last_undegraded":"2024-04-25T15:30:30.611756+0000","last_fullsized":"2024-04-25T15:30:30.611756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":2143,"num_write_kb":17826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'3058","reported_seq":2449,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.782748+0000","last_change":"2024-04-25T15:30:33.086094+0000","last_active":"2024-04-25T15:30:36.782748+0000","last_peered":"2024-04-25T15:30:36.782748+0000","last_clean":"2024-04-25T15:30:36.782748+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:30:36.782748+0000","last_undegraded":"2024-04-25T15:30:36.782748+0000","last_fullsized":"2024-04-25T15:30:36.782748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:16.090008+0000","scrub_duration":0,"objects_trimmed":246,"snaptrim_duration":2.487939248,"stat_sum":{"num_bytes":6832,"num_objects":457,"num_object_clones":228,"num_object_copies":914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602229+0000","last_change":"2024-04-25T15:20:30.873208+0000","last_active":"2024-04-25T15:30:30.602229+0000","last_peered":"2024-04-25T15:30:30.602229+0000","last_clean":"2024-04-25T15:30:30.602229+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:30:30.602229+0000","last_undegraded":"2024-04-25T15:30:30.602229+0000","last_fullsized":"2024-04-25T15:30:30.602229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_clean_scrub_stamp":"2024-04-25T15:20:29.835147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:59.356200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"40'1171","reported_seq":1231,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593277+0000","last_change":"2024-04-25T15:20:41.403922+0000","last_active":"2024-04-25T15:30:30.593277+0000","last_peered":"2024-04-25T15:30:30.593277+0000","last_clean":"2024-04-25T15:30:30.593277+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:30:30.593277+0000","last_undegraded":"2024-04-25T15:30:30.593277+0000","last_fullsized":"2024-04-25T15:30:30.593277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1252,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"41'2570","reported_seq":2122,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.823536+0000","last_change":"2024-04-25T15:30:30.590019+0000","last_active":"2024-04-25T15:30:36.823536+0000","last_peered":"2024-04-25T15:30:36.823536+0000","last_clean":"2024-04-25T15:30:36.823536+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:30:36.823536+0000","last_undegraded":"2024-04-25T15:30:36.823536+0000","last_fullsized":"2024-04-25T15:30:36.823536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2570,"log_dups_size":0,"ondisk_log_size":2570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:33.739781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.6625848130000001,"stat_sum":{"num_bytes":5283,"num_objects":698,"num_object_clones":460,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":698,"num_whiteouts":237,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"41'3615","reported_seq":3675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:36.643537+0000","last_change":"2024-04-25T15:20:41.410568+0000","last_active":"2024-04-25T15:30:36.643537+0000","last_peered":"2024-04-25T15:30:36.643537+0000","last_clean":"2024-04-25T15:30:36.643537+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:30:36.643537+0000","last_undegraded":"2024-04-25T15:30:36.643537+0000","last_fullsized":"2024-04-25T15:30:36.643537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6520497,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":3670,"num_write_kb":20386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"41'3126","reported_seq":2493,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.769564+0000","last_change":"2024-04-25T15:30:33.021932+0000","last_active":"2024-04-25T15:30:36.769564+0000","last_peered":"2024-04-25T15:30:36.769564+0000","last_clean":"2024-04-25T15:30:36.769564+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:30:36.769564+0000","last_undegraded":"2024-04-25T15:30:36.769564+0000","last_fullsized":"2024-04-25T15:30:36.769564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3126,"log_dups_size":0,"ondisk_log_size":3126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:46.761461+0000","scrub_duration":0,"objects_trimmed":238,"snaptrim_duration":2.4295429180000001,"stat_sum":{"num_bytes":2760,"num_objects":460,"num_object_clones":230,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":460,"num_whiteouts":230,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1","version":"40'2374","reported_seq":2747,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.608333+0000","last_change":"2024-04-25T15:20:41.406046+0000","last_active":"2024-04-25T15:30:30.608333+0000","last_peered":"2024-04-25T15:30:30.608333+0000","last_clean":"2024-04-25T15:30:30.608333+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:30:30.608333+0000","last_undegraded":"2024-04-25T15:30:30.608333+0000","last_fullsized":"2024-04-25T15:30:30.608333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2374,"log_dups_size":0,"ondisk_log_size":2374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11691863,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":329,"num_read_kb":3430,"num_write":2430,"num_write_kb":16848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"41'3413","reported_seq":2728,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.608544+0000","last_change":"2024-04-25T15:30:37.608587+0000","last_active":"2024-04-25T15:30:37.608544+0000","last_peered":"2024-04-25T15:30:37.608544+0000","last_clean":"2024-04-25T15:30:37.608544+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:30:37.608544+0000","last_undegraded":"2024-04-25T15:30:37.608544+0000","last_fullsized":"2024-04-25T15:30:37.608544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:20.257648+0000","scrub_duration":0,"objects_trimmed":723,"snaptrim_duration":7.0088171780000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.2","version":"40'6781","reported_seq":6841,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.594013+0000","last_change":"2024-04-25T15:20:41.410676+0000","last_active":"2024-04-25T15:30:30.594013+0000","last_peered":"2024-04-25T15:30:30.594013+0000","last_clean":"2024-04-25T15:30:30.594013+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:30:30.594013+0000","last_undegraded":"2024-04-25T15:30:30.594013+0000","last_fullsized":"2024-04-25T15:30:30.594013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6781,"log_dups_size":0,"ondisk_log_size":6781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":6828,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"41'3641","reported_seq":2884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676561+0000","last_change":"2024-04-25T15:30:38.676800+0000","last_active":"2024-04-25T15:30:38.676561+0000","last_peered":"2024-04-25T15:30:38.676561+0000","last_clean":"2024-04-25T15:30:38.676561+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:30:38.676561+0000","last_undegraded":"2024-04-25T15:30:38.676561+0000","last_fullsized":"2024-04-25T15:30:38.676561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.134412+0000","scrub_duration":0,"objects_trimmed":737,"snaptrim_duration":8.0788980660000007,"stat_sum":{"num_bytes":21,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1263,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.4","version":"40'144","reported_seq":203,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599943+0000","last_change":"2024-04-25T15:20:41.413703+0000","last_active":"2024-04-25T15:30:30.599943+0000","last_peered":"2024-04-25T15:30:30.599943+0000","last_clean":"2024-04-25T15:30:30.599943+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:30:30.599943+0000","last_undegraded":"2024-04-25T15:30:30.599943+0000","last_fullsized":"2024-04-25T15:30:30.599943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":208,"num_write_kb":8700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"41'2817","reported_seq":2279,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.562635+0000","last_change":"2024-04-25T15:30:37.562677+0000","last_active":"2024-04-25T15:30:37.562635+0000","last_peered":"2024-04-25T15:30:37.562635+0000","last_clean":"2024-04-25T15:30:37.562635+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:30:37.562635+0000","last_undegraded":"2024-04-25T15:30:37.562635+0000","last_fullsized":"2024-04-25T15:30:37.562635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2817,"log_dups_size":0,"ondisk_log_size":2817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:53.738899+0000","scrub_duration":0,"objects_trimmed":229,"snaptrim_duration":6.9682819660000002,"stat_sum":{"num_bytes":10772,"num_objects":435,"num_object_clones":217,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":216,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.5","version":"40'1973","reported_seq":2033,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598648+0000","last_change":"2024-04-25T15:20:41.408759+0000","last_active":"2024-04-25T15:30:30.598648+0000","last_peered":"2024-04-25T15:30:30.598648+0000","last_clean":"2024-04-25T15:30:30.598648+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:30:30.598648+0000","last_undegraded":"2024-04-25T15:30:30.598648+0000","last_fullsized":"2024-04-25T15:30:30.598648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1973,"log_dups_size":0,"ondisk_log_size":1973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:41.992733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2030,"num_write_kb":21675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"41'3370","reported_seq":2703,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.816380+0000","last_change":"2024-04-25T15:30:38.749936+0000","last_active":"2024-04-25T15:30:39.816380+0000","last_peered":"2024-04-25T15:30:39.816380+0000","last_clean":"2024-04-25T15:30:39.816380+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:30:39.816380+0000","last_undegraded":"2024-04-25T15:30:39.816380+0000","last_fullsized":"2024-04-25T15:30:39.816380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:26.387482+0000","scrub_duration":0,"objects_trimmed":590,"snaptrim_duration":3.4419109580000002,"stat_sum":{"num_bytes":600,"num_objects":102,"num_object_clones":51,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":51,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.6","version":"41'2504","reported_seq":2563,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.601549+0000","last_change":"2024-04-25T15:20:41.409877+0000","last_active":"2024-04-25T15:30:30.601549+0000","last_peered":"2024-04-25T15:30:30.601549+0000","last_clean":"2024-04-25T15:30:30.601549+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:30:30.601549+0000","last_undegraded":"2024-04-25T15:30:30.601549+0000","last_fullsized":"2024-04-25T15:30:30.601549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2504,"log_dups_size":0,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3243,"num_write_kb":16596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'2748","reported_seq":2258,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.840360+0000","last_change":"2024-04-25T15:30:39.401031+0000","last_active":"2024-04-25T15:30:39.840360+0000","last_peered":"2024-04-25T15:30:39.840360+0000","last_clean":"2024-04-25T15:30:39.840360+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:30:39.840360+0000","last_undegraded":"2024-04-25T15:30:39.840360+0000","last_fullsized":"2024-04-25T15:30:39.840360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2748,"log_dups_size":0,"ondisk_log_size":2748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.298428+0000","scrub_duration":0,"objects_trimmed":78,"snaptrim_duration":2.6626469959999999,"stat_sum":{"num_bytes":8735,"num_objects":640,"num_object_clones":400,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":640,"num_whiteouts":239,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"40'133","reported_seq":193,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602613+0000","last_change":"2024-04-25T15:20:41.410949+0000","last_active":"2024-04-25T15:30:30.602613+0000","last_peered":"2024-04-25T15:30:30.602613+0000","last_clean":"2024-04-25T15:30:30.602613+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:30:30.602613+0000","last_undegraded":"2024-04-25T15:30:30.602613+0000","last_fullsized":"2024-04-25T15:30:30.602613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":213,"num_write_kb":8722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"41'2840","reported_seq":2302,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.261992+0000","last_change":"2024-04-25T15:30:39.262015+0000","last_active":"2024-04-25T15:30:39.261992+0000","last_peered":"2024-04-25T15:30:39.261992+0000","last_clean":"2024-04-25T15:30:39.261992+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:39.261992+0000","last_undegraded":"2024-04-25T15:30:39.261992+0000","last_fullsized":"2024-04-25T15:30:39.261992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.556786+0000","scrub_duration":0,"objects_trimmed":222,"snaptrim_duration":8.6675915420000003,"stat_sum":{"num_bytes":2592,"num_objects":432,"num_object_clones":216,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":216,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.8","version":"40'1036","reported_seq":1096,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600029+0000","last_change":"2024-04-25T15:20:41.405078+0000","last_active":"2024-04-25T15:30:30.600029+0000","last_peered":"2024-04-25T15:30:30.600029+0000","last_clean":"2024-04-25T15:30:30.600029+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:30:30.600029+0000","last_undegraded":"2024-04-25T15:30:30.600029+0000","last_fullsized":"2024-04-25T15:30:30.600029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1104,"num_write_kb":9199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"41'3352","reported_seq":2651,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.171838+0000","last_change":"2024-04-25T15:30:39.172045+0000","last_active":"2024-04-25T15:30:39.171838+0000","last_peered":"2024-04-25T15:30:39.171838+0000","last_clean":"2024-04-25T15:30:39.171838+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:39.171838+0000","last_undegraded":"2024-04-25T15:30:39.171838+0000","last_fullsized":"2024-04-25T15:30:39.171838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:59.054566+0000","scrub_duration":0,"objects_trimmed":673,"snaptrim_duration":8.5715076529999994,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.9","version":"40'1878","reported_seq":1937,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599834+0000","last_change":"2024-04-25T15:20:41.411766+0000","last_active":"2024-04-25T15:30:30.599834+0000","last_peered":"2024-04-25T15:30:30.599834+0000","last_clean":"2024-04-25T15:30:30.599834+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:30:30.599834+0000","last_undegraded":"2024-04-25T15:30:30.599834+0000","last_fullsized":"2024-04-25T15:30:30.599834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":1954,"num_write_kb":17506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"41'2829","reported_seq":2287,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.836669+0000","last_change":"2024-04-25T15:30:38.771956+0000","last_active":"2024-04-25T15:30:39.836669+0000","last_peered":"2024-04-25T15:30:39.836669+0000","last_clean":"2024-04-25T15:30:39.836669+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:30:39.836669+0000","last_undegraded":"2024-04-25T15:30:39.836669+0000","last_fullsized":"2024-04-25T15:30:39.836669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:25.485998+0000","scrub_duration":0,"objects_trimmed":176,"snaptrim_duration":2.6649829270000001,"stat_sum":{"num_bytes":3554,"num_objects":537,"num_object_clones":302,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":537,"num_whiteouts":234,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"40'3651","reported_seq":3710,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600436+0000","last_change":"2024-04-25T15:20:41.406926+0000","last_active":"2024-04-25T15:30:30.600436+0000","last_peered":"2024-04-25T15:30:30.600436+0000","last_clean":"2024-04-25T15:30:30.600436+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:30:30.600436+0000","last_undegraded":"2024-04-25T15:30:30.600436+0000","last_fullsized":"2024-04-25T15:30:30.600436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3651,"log_dups_size":0,"ondisk_log_size":3651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3718,"num_write_kb":26255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"41'2742","reported_seq":2232,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.853678+0000","last_change":"2024-04-25T15:30:36.468277+0000","last_active":"2024-04-25T15:30:36.853678+0000","last_peered":"2024-04-25T15:30:36.853678+0000","last_clean":"2024-04-25T15:30:36.853678+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:30:36.853678+0000","last_undegraded":"2024-04-25T15:30:36.853678+0000","last_fullsized":"2024-04-25T15:30:36.853678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:14.515815+0000","scrub_duration":0,"objects_trimmed":221,"snaptrim_duration":5.8786392230000004,"stat_sum":{"num_bytes":2436,"num_objects":408,"num_object_clones":204,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.b","version":"40'5227","reported_seq":5287,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599376+0000","last_change":"2024-04-25T15:20:41.408140+0000","last_active":"2024-04-25T15:30:30.599376+0000","last_peered":"2024-04-25T15:30:30.599376+0000","last_clean":"2024-04-25T15:30:30.599376+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:30:30.599376+0000","last_undegraded":"2024-04-25T15:30:30.599376+0000","last_fullsized":"2024-04-25T15:30:30.599376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":5301,"num_write_kb":30551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"41'3710","reported_seq":2942,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.060514+0000","last_change":"2024-04-25T15:30:38.060564+0000","last_active":"2024-04-25T15:30:38.060514+0000","last_peered":"2024-04-25T15:30:38.060514+0000","last_clean":"2024-04-25T15:30:38.060514+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:30:38.060514+0000","last_undegraded":"2024-04-25T15:30:38.060514+0000","last_fullsized":"2024-04-25T15:30:38.060514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.286828+0000","scrub_duration":0,"objects_trimmed":693,"snaptrim_duration":7.4581421309999998,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.1d","version":"41'2917","reported_seq":2396,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.809207+0000","last_change":"2024-04-25T15:30:35.988171+0000","last_active":"2024-04-25T15:30:36.809207+0000","last_peered":"2024-04-25T15:30:36.809207+0000","last_clean":"2024-04-25T15:30:36.809207+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:30:36.809207+0000","last_undegraded":"2024-04-25T15:30:36.809207+0000","last_fullsized":"2024-04-25T15:30:36.809207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:52.844251+0000","scrub_duration":0,"objects_trimmed":236,"snaptrim_duration":5.3939467600000004,"stat_sum":{"num_bytes":6688,"num_objects":440,"num_object_clones":218,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":218,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1c","version":"40'1127","reported_seq":1186,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.597966+0000","last_change":"2024-04-25T15:20:41.408459+0000","last_active":"2024-04-25T15:30:30.597966+0000","last_peered":"2024-04-25T15:30:30.597966+0000","last_clean":"2024-04-25T15:30:30.597966+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:30:30.597966+0000","last_undegraded":"2024-04-25T15:30:30.597966+0000","last_fullsized":"2024-04-25T15:30:30.597966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1211,"num_write_kb":4844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'3265","reported_seq":2622,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.550371+0000","last_change":"2024-04-25T15:30:39.550417+0000","last_active":"2024-04-25T15:30:39.550371+0000","last_peered":"2024-04-25T15:30:39.550371+0000","last_clean":"2024-04-25T15:30:39.550371+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:30:39.550371+0000","last_undegraded":"2024-04-25T15:30:39.550371+0000","last_fullsized":"2024-04-25T15:30:39.550371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3265,"log_dups_size":0,"ondisk_log_size":3265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:12.255072+0000","scrub_duration":0,"objects_trimmed":285,"snaptrim_duration":8.9557072630000008,"stat_sum":{"num_bytes":7324,"num_objects":540,"num_object_clones":269,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":269,"num_read":0,"num_read_kb":0,"num_write":1350,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1d","version":"40'8160","reported_seq":8219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598260+0000","last_change":"2024-04-25T15:20:41.408914+0000","last_active":"2024-04-25T15:30:30.598260+0000","last_peered":"2024-04-25T15:30:30.598260+0000","last_clean":"2024-04-25T15:30:30.598260+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:30:30.598260+0000","last_undegraded":"2024-04-25T15:30:30.598260+0000","last_fullsized":"2024-04-25T15:30:30.598260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":8160,"log_dups_size":0,"ondisk_log_size":8160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.598854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":8233,"num_write_kb":32021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"41'2841","reported_seq":2305,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.843142+0000","last_change":"2024-04-25T15:30:39.797864+0000","last_active":"2024-04-25T15:30:39.843142+0000","last_peered":"2024-04-25T15:30:39.843142+0000","last_clean":"2024-04-25T15:30:39.843142+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:30:39.843142+0000","last_undegraded":"2024-04-25T15:30:39.843142+0000","last_fullsized":"2024-04-25T15:30:39.843142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:18.229589+0000","scrub_duration":0,"objects_trimmed":251,"snaptrim_duration":1.5925796669999999,"stat_sum":{"num_bytes":2508,"num_objects":419,"num_object_clones":209,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1e","version":"40'6121","reported_seq":6181,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589353+0000","last_change":"2024-04-25T15:20:41.405976+0000","last_active":"2024-04-25T15:30:30.589353+0000","last_peered":"2024-04-25T15:30:30.589353+0000","last_clean":"2024-04-25T15:30:30.589353+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:30:30.589353+0000","last_undegraded":"2024-04-25T15:30:30.589353+0000","last_fullsized":"2024-04-25T15:30:30.589353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6121,"log_dups_size":0,"ondisk_log_size":6121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":6190,"num_write_kb":31064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"41'3023","reported_seq":2424,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.767688+0000","last_change":"2024-04-25T15:30:35.716433+0000","last_active":"2024-04-25T15:30:36.767688+0000","last_peered":"2024-04-25T15:30:36.767688+0000","last_clean":"2024-04-25T15:30:36.767688+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:30:36.767688+0000","last_undegraded":"2024-04-25T15:30:36.767688+0000","last_fullsized":"2024-04-25T15:30:36.767688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3023,"log_dups_size":0,"ondisk_log_size":3023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:17.235338+0000","scrub_duration":0,"objects_trimmed":234,"snaptrim_duration":5.1271952929999998,"stat_sum":{"num_bytes":6664,"num_objects":429,"num_object_clones":214,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":429,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1f","version":"40'2537","reported_seq":2597,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593005+0000","last_change":"2024-04-25T15:20:41.410750+0000","last_active":"2024-04-25T15:30:30.593005+0000","last_peered":"2024-04-25T15:30:30.593005+0000","last_clean":"2024-04-25T15:30:30.593005+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:30:30.593005+0000","last_undegraded":"2024-04-25T15:30:30.593005+0000","last_fullsized":"2024-04-25T15:30:30.593005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2537,"log_dups_size":0,"ondisk_log_size":2537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2610,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":250090,"num_objects":20120,"num_object_clones":10299,"num_object_copies":40240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20120,"num_whiteouts":9706,"num_read":44,"num_read_kb":30,"num_write":77732,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84484096,"data_stored":499700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203889,"ondisk_log_size":203889,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":265677919,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":835,"num_read_kb":3430,"num_write":91102,"num_write_kb":583108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":531415040,"data_stored":531355838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88184,"ondisk_log_size":88184,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":416236,"kb_used_data":82404,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":93955604,"statfs":{"total":96636764160,"available":96210538496,"internally_reserved":0,"allocated":84381696,"data_stored":66132745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":341834186},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396336,"kb_used_data":86120,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":93975504,"statfs":{"total":96636764160,"available":96230916096,"internally_reserved":0,"allocated":88186880,"data_stored":84126126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574973,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388852,"kb_used_data":96684,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93982988,"statfs":{"total":96636764160,"available":96238579712,"internally_reserved":0,"allocated":99004416,"data_stored":84177428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574973,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411104,"kb_used_data":73108,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":93960736,"statfs":{"total":96636764160,"available":96215793664,"internally_reserved":0,"allocated":74862592,"data_stored":63176542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346094022},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,3,3,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391964,"kb_used_data":85968,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93979876,"statfs":{"total":96636764160,"available":96235393024,"internally_reserved":0,"allocated":88031232,"data_stored":70719157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":313326023},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188228,"kb_used_data":40508,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94183612,"statfs":{"total":96636764160,"available":96444018688,"internally_reserved":0,"allocated":41480192,"data_stored":37093920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407400,"kb_used_data":91608,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93964440,"statfs":{"total":96636764160,"available":96219586560,"internally_reserved":0,"allocated":93806592,"data_stored":86453251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":323353029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326652,"kb_used_data":56748,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94045188,"statfs":{"total":96636764160,"available":96302272512,"internally_reserved":0,"allocated":58109952,"data_stored":42806283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86220800,"data_stored":86212586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36859904,"data_stored":36857687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70422528,"data_stored":70412791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62926848,"data_stored":62914839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83890176,"data_stored":83886170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83894272,"data_stored":83886752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65245184,"data_stored":65241335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14450688,"data_stored":66754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5922816,"data_stored":33618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3985408,"data_stored":32095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15921152,"data_stored":99292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10637312,"data_stored":55684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14123008,"data_stored":86097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3084288,"data_stored":33556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16359424,"data_stored":92604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:30:42.528 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:30:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.743+0000 7f94a3230640 1 Processor -- start 2024-04-25T15:30:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.743+0000 7f94a3230640 1 -- start start 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a3230640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9494037e70 0x7f949402ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a3230640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f94940374e0 0x7f9494029f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a3230640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949402b340 con 0x7f949402a480 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a3230640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f94940378f0 con 0x7f94940374e0 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a3230640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f949402b620 con 0x7f9494037e70 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a1a2d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f94940374e0 0x7f9494029f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a2a2f640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f949402a480 0x7f94940c4480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43626/0 (socket says 172.21.15.33:43626) 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a2a2f640 1 -- 172.21.15.33:0/172264848 learned_addr learned my addr 172.21.15.33:0/172264848 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.745+0000 7f94a222e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9494037e70 0x7f949402ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.746+0000 7f94a222e640 1 -- 172.21.15.33:0/172264848 >> v2:172.21.15.33:3300/0 conn(0x7f94940374e0 msgr2=0x7f9494029f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.746+0000 7f94a222e640 1 --2- 172.21.15.33:0/172264848 >> v2:172.21.15.33:3300/0 conn(0x7f94940374e0 0x7f9494029f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.746+0000 7f94a222e640 1 -- 172.21.15.33:0/172264848 >> v1:172.21.15.33:6789/0 conn(0x7f949402a480 legacy=0x7f94940c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.746+0000 7f94a222e640 1 -- 172.21.15.33:0/172264848 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949402a890 con 0x7f9494037e70 2024-04-25T15:30:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.747+0000 7f94a222e640 1 --2- 172.21.15.33:0/172264848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 0x7f949402ad20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f949c066010 tx=0x7f949c0a72b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd921efa1219f38e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:42.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.748+0000 7f94a122c640 1 -- 172.21.15.33:0/172264848 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0b4070 con 0x7f9494037e70 2024-04-25T15:30:42.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.748+0000 7f94a122c640 1 -- 172.21.15.33:0/172264848 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f949c0af440 con 0x7f9494037e70 2024-04-25T15:30:42.749 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.748+0000 7f94a122c640 1 -- 172.21.15.33:0/172264848 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0af870 con 0x7f9494037e70 2024-04-25T15:30:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.749+0000 7f94a3230640 1 -- 172.21.15.33:0/172264848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 msgr2=0x7f949402ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.749+0000 7f94a3230640 1 --2- 172.21.15.33:0/172264848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 0x7f949402ad20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f949c066010 tx=0x7f949c0a72b0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.750+0000 7f94a3230640 1 -- 172.21.15.33:0/172264848 shutdown_connections 2024-04-25T15:30:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.750+0000 7f94a3230640 1 --2- 172.21.15.33:0/172264848 >> v2:172.21.15.33:3300/0 conn(0x7f94940374e0 0x7f9494029f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.750+0000 7f94a3230640 1 --2- 172.21.15.33:0/172264848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 0x7f949402ad20 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.750+0000 7f94a3230640 1 -- 172.21.15.33:0/172264848 >> 172.21.15.33:0/172264848 conn(0x7f949403b270 msgr2=0x7f9494006090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:42.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.751+0000 7f94a3230640 1 -- 172.21.15.33:0/172264848 shutdown_connections 2024-04-25T15:30:42.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.751+0000 7f94a3230640 1 -- 172.21.15.33:0/172264848 wait complete. 2024-04-25T15:30:42.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.754+0000 7f94a3230640 1 Processor -- start 2024-04-25T15:30:42.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.754+0000 7f94a3230640 1 -- start start 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.756+0000 7f94a3230640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949402a480 0x7f94940bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.756+0000 7f94a3230640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94940374e0 0x7f9494163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.756+0000 7f94a3230640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 0x7f94940bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.756+0000 7f94a222e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949402a480 0x7f94940bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.756+0000 7f94a222e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949402a480 0x7f94940bfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:38884/0 (socket says 172.21.15.33:38884) 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.756+0000 7f94a1a2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94940374e0 0x7f9494163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.756+0000 7f94a1a2d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94940374e0 0x7f9494163760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45408/0 (socket says 172.21.15.33:45408) 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.757+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f94940c4d10 con 0x7f94940374e0 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.756+0000 7f94a222e640 1 -- 172.21.15.33:0/2572453085 learned_addr learned my addr 172.21.15.33:0/2572453085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.757+0000 7f94a2a2f640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 0x7f94940bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.757+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94940c4b90 con 0x7f9494037e70 2024-04-25T15:30:42.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.757+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94940c4e90 con 0x7f949402a480 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.758+0000 7f94a222e640 1 -- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 msgr2=0x7f94940bbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.758+0000 7f94a222e640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 0x7f94940bbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.758+0000 7f94a222e640 1 -- 172.21.15.33:0/2572453085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94940374e0 msgr2=0x7f9494163760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.758+0000 7f94a222e640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94940374e0 0x7f9494163760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.758+0000 7f94a222e640 1 -- 172.21.15.33:0/2572453085 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9494163ca0 con 0x7f949402a480 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.758+0000 7f94a1a2d640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94940374e0 0x7f9494163760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.758+0000 7f94a222e640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949402a480 0x7f94940bfeb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f949c000b60 tx=0x7f949c06a600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.759+0000 7f9492ffd640 1 -- 172.21.15.33:0/2572453085 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0b4050 con 0x7f949402a480 2024-04-25T15:30:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.759+0000 7f9492ffd640 1 -- 172.21.15.33:0/2572453085 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f949c0c0070 con 0x7f949402a480 2024-04-25T15:30:42.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.760+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94940cbda0 con 0x7f949402a480 2024-04-25T15:30:42.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.760+0000 7f9492ffd640 1 -- 172.21.15.33:0/2572453085 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0aed60 con 0x7f949402a480 2024-04-25T15:30:42.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.760+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f94940cc360 con 0x7f949402a480 2024-04-25T15:30:42.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.762+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94940cbb90 con 0x7f949402a480 2024-04-25T15:30:42.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.763+0000 7f9492ffd640 1 -- 172.21.15.33:0/2572453085 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f949c0bb450 con 0x7f949402a480 2024-04-25T15:30:42.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.764+0000 7f9492ffd640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f94800744e0 0x7f94800769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:42.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.764+0000 7f94a1a2d640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f94800744e0 0x7f94800769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:42.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.764+0000 7f9492ffd640 1 -- 172.21.15.33:0/2572453085 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f949c132a50 con 0x7f949402a480 2024-04-25T15:30:42.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.765+0000 7f94a1a2d640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f94800744e0 0x7f94800769f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f94940c0ec0 tx=0x7f948c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:42.772+0000 7f9492ffd640 1 -- 172.21.15.33:0/2572453085 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f949c0fcb40 con 0x7f949402a480 2024-04-25T15:30:43.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.142+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9494005570 con 0x7f94800744e0 2024-04-25T15:30:43.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.154+0000 7f9492ffd640 1 -- 172.21.15.33:0/2572453085 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258476 (secure 0 0 0) 0x7f9494005570 con 0x7f94800744e0 2024-04-25T15:30:43.158 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:30:43.161 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:30:43.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f94800744e0 msgr2=0x7f94800769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f94800744e0 0x7f94800769f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f94940c0ec0 tx=0x7f948c009190 comp rx=0 tx=0).stop 2024-04-25T15:30:43.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949402a480 msgr2=0x7f94940bfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949402a480 0x7f94940bfeb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f949c000b60 tx=0x7f949c06a600 comp rx=0 tx=0).stop 2024-04-25T15:30:43.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 shutdown_connections 2024-04-25T15:30:43.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f94800744e0 0x7f94800769f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9494037e70 0x7f94940bbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94940374e0 0x7f9494163760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 --2- 172.21.15.33:0/2572453085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f949402a480 0x7f94940bfeb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 >> 172.21.15.33:0/2572453085 conn(0x7f949403b270 msgr2=0x7f9494004a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:43.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 shutdown_connections 2024-04-25T15:30:43.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.159+0000 7f94a3230640 1 -- 172.21.15.33:0/2572453085 wait complete. 2024-04-25T15:30:43.179 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-04-25T15:30:41.848948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":266518377,"num_objects":20736,"num_object_clones":10299,"num_object_copies":41472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20736,"num_whiteouts":9706,"num_read":945,"num_read_kb":3515,"num_write":168935,"num_write_kb":625333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292145,"ondisk_log_size":292145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2926772,"kb_used_data":613148,"kb_used_omap":12,"kb_used_meta":2313523,"kb_avail":752047948,"statfs":{"total":773094113280,"available":770097098752,"internally_reserved":0,"allocated":627863552,"data_stored":534685452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":2369048114},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,7,9,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-147898,"num_objects":-24870,"num_object_clones":-19457,"num_object_copies":-49740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24870,"num_whiteouts":-5413,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.256374"},"pg_stats":[{"pgid":"3.3f","version":"41'2829","reported_seq":2323,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.717491+0000","last_change":"2024-04-25T15:30:37.717537+0000","last_active":"2024-04-25T15:30:37.717491+0000","last_peered":"2024-04-25T15:30:37.717491+0000","last_clean":"2024-04-25T15:30:37.717491+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:30:37.717491+0000","last_undegraded":"2024-04-25T15:30:37.717491+0000","last_fullsized":"2024-04-25T15:30:37.717491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:24.611556+0000","scrub_duration":0,"objects_trimmed":224,"snaptrim_duration":7.1170097969999997,"stat_sum":{"num_bytes":2448,"num_objects":410,"num_object_clones":204,"num_object_copies":820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3e","version":"41'2630","reported_seq":2112,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.161216+0000","last_change":"2024-04-25T15:30:37.161265+0000","last_active":"2024-04-25T15:30:37.161216+0000","last_peered":"2024-04-25T15:30:37.161216+0000","last_clean":"2024-04-25T15:30:37.161216+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:30:37.161216+0000","last_undegraded":"2024-04-25T15:30:37.161216+0000","last_fullsized":"2024-04-25T15:30:37.161216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2630,"log_dups_size":0,"ondisk_log_size":2630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:52.269365+0000","scrub_duration":0,"objects_trimmed":224,"snaptrim_duration":6.5598153510000001,"stat_sum":{"num_bytes":2472,"num_objects":412,"num_object_clones":206,"num_object_copies":824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":412,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3d","version":"41'3137","reported_seq":2548,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.882826+0000","last_change":"2024-04-25T15:30:37.882872+0000","last_active":"2024-04-25T15:30:37.882826+0000","last_peered":"2024-04-25T15:30:37.882826+0000","last_clean":"2024-04-25T15:30:37.882826+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:30:37.882826+0000","last_undegraded":"2024-04-25T15:30:37.882826+0000","last_fullsized":"2024-04-25T15:30:37.882826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:14.294299+0000","scrub_duration":0,"objects_trimmed":237,"snaptrim_duration":7.2888411399999997,"stat_sum":{"num_bytes":6820,"num_objects":458,"num_object_clones":227,"num_object_copies":916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":458,"num_whiteouts":227,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3c","version":"41'3136","reported_seq":2496,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.803853+0000","last_change":"2024-04-25T15:30:39.688349+0000","last_active":"2024-04-25T15:30:39.803853+0000","last_peered":"2024-04-25T15:30:39.803853+0000","last_clean":"2024-04-25T15:30:39.803853+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:30:39.803853+0000","last_undegraded":"2024-04-25T15:30:39.803853+0000","last_fullsized":"2024-04-25T15:30:39.803853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3136,"log_dups_size":0,"ondisk_log_size":3136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.556786+0000","scrub_duration":0,"objects_trimmed":312,"snaptrim_duration":4.1254658519999996,"stat_sum":{"num_bytes":10939,"num_objects":462,"num_object_clones":228,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":462,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3b","version":"41'3146","reported_seq":2504,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.714065+0000","last_change":"2024-04-25T15:30:36.290986+0000","last_active":"2024-04-25T15:30:36.714065+0000","last_peered":"2024-04-25T15:30:36.714065+0000","last_clean":"2024-04-25T15:30:36.714065+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:30:36.714065+0000","last_undegraded":"2024-04-25T15:30:36.714065+0000","last_fullsized":"2024-04-25T15:30:36.714065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3146,"log_dups_size":0,"ondisk_log_size":3146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:42.248138+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":5.6918965269999999,"stat_sum":{"num_bytes":6976,"num_objects":481,"num_object_clones":240,"num_object_copies":962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3a","version":"41'3483","reported_seq":2770,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.701126+0000","last_change":"2024-04-25T15:30:38.703165+0000","last_active":"2024-04-25T15:30:38.701126+0000","last_peered":"2024-04-25T15:30:38.701126+0000","last_clean":"2024-04-25T15:30:38.701126+0000","last_became_active":"2024-04-25T15:21:23.754462+0000","last_became_peered":"2024-04-25T15:21:23.754462+0000","last_unstale":"2024-04-25T15:30:38.701126+0000","last_undegraded":"2024-04-25T15:30:38.701126+0000","last_fullsized":"2024-04-25T15:30:38.701126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3483,"log_dups_size":0,"ondisk_log_size":3483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:36.167106+0000","scrub_duration":0,"objects_trimmed":689,"snaptrim_duration":8.0917395699999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.39","version":"41'2960","reported_seq":2399,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.826398+0000","last_change":"2024-04-25T15:30:39.508551+0000","last_active":"2024-04-25T15:30:39.826398+0000","last_peered":"2024-04-25T15:30:39.826398+0000","last_clean":"2024-04-25T15:30:39.826398+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:30:39.826398+0000","last_undegraded":"2024-04-25T15:30:39.826398+0000","last_fullsized":"2024-04-25T15:30:39.826398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2960,"log_dups_size":0,"ondisk_log_size":2960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:13.096251+0000","scrub_duration":0,"objects_trimmed":355,"snaptrim_duration":2.4448173,"stat_sum":{"num_bytes":6152,"num_objects":330,"num_object_clones":164,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":330,"num_whiteouts":163,"num_read":1,"num_read_kb":0,"num_write":1188,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.38","version":"41'2720","reported_seq":2196,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.856018+0000","last_change":"2024-04-25T15:30:32.858743+0000","last_active":"2024-04-25T15:30:36.856018+0000","last_peered":"2024-04-25T15:30:36.856018+0000","last_clean":"2024-04-25T15:30:36.856018+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:30:36.856018+0000","last_undegraded":"2024-04-25T15:30:36.856018+0000","last_fullsized":"2024-04-25T15:30:36.856018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2720,"log_dups_size":0,"ondisk_log_size":2720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:39.840877+0000","scrub_duration":0,"objects_trimmed":237,"snaptrim_duration":2.2674431460000002,"stat_sum":{"num_bytes":6724,"num_objects":439,"num_object_clones":219,"num_object_copies":878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":219,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.37","version":"41'3084","reported_seq":2514,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.877805+0000","last_change":"2024-04-25T15:30:38.877851+0000","last_active":"2024-04-25T15:30:38.877805+0000","last_peered":"2024-04-25T15:30:38.877805+0000","last_clean":"2024-04-25T15:30:38.877805+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:30:38.877805+0000","last_undegraded":"2024-04-25T15:30:38.877805+0000","last_fullsized":"2024-04-25T15:30:38.877805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:34.457672+0000","scrub_duration":0,"objects_trimmed":251,"snaptrim_duration":8.2771185579999997,"stat_sum":{"num_bytes":2748,"num_objects":460,"num_object_clones":229,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":460,"num_whiteouts":229,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.36","version":"41'3421","reported_seq":2816,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.170307+0000","last_change":"2024-04-25T15:30:37.170350+0000","last_active":"2024-04-25T15:30:37.170307+0000","last_peered":"2024-04-25T15:30:37.170307+0000","last_clean":"2024-04-25T15:30:37.170307+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:30:37.170307+0000","last_undegraded":"2024-04-25T15:30:37.170307+0000","last_fullsized":"2024-04-25T15:30:37.170307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:26.387482+0000","scrub_duration":0,"objects_trimmed":653,"snaptrim_duration":6.5677128429999998,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.35","version":"41'3365","reported_seq":2707,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.723622+0000","last_change":"2024-04-25T15:30:36.328180+0000","last_active":"2024-04-25T15:30:36.723622+0000","last_peered":"2024-04-25T15:30:36.723622+0000","last_clean":"2024-04-25T15:30:36.723622+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:30:36.723622+0000","last_undegraded":"2024-04-25T15:30:36.723622+0000","last_fullsized":"2024-04-25T15:30:36.723622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:20.257648+0000","scrub_duration":0,"objects_trimmed":691,"snaptrim_duration":5.7256742149999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.34","version":"41'3667","reported_seq":2916,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.675536+0000","last_change":"2024-04-25T15:30:38.675909+0000","last_active":"2024-04-25T15:30:38.675536+0000","last_peered":"2024-04-25T15:30:38.675536+0000","last_clean":"2024-04-25T15:30:38.675536+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:30:38.675536+0000","last_undegraded":"2024-04-25T15:30:38.675536+0000","last_fullsized":"2024-04-25T15:30:38.675536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:10.365408+0000","scrub_duration":0,"objects_trimmed":759,"snaptrim_duration":8.0780853560000008,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.33","version":"41'2832","reported_seq":2321,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.529493+0000","last_change":"2024-04-25T15:30:37.529542+0000","last_active":"2024-04-25T15:30:37.529493+0000","last_peered":"2024-04-25T15:30:37.529493+0000","last_clean":"2024-04-25T15:30:37.529493+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:30:37.529493+0000","last_undegraded":"2024-04-25T15:30:37.529493+0000","last_fullsized":"2024-04-25T15:30:37.529493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:18.828740+0000","scrub_duration":0,"objects_trimmed":225,"snaptrim_duration":6.9396563239999995,"stat_sum":{"num_bytes":6660,"num_objects":425,"num_object_clones":211,"num_object_copies":850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":425,"num_whiteouts":211,"num_read":1,"num_read_kb":0,"num_write":1152,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.32","version":"41'2851","reported_seq":2296,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.820687+0000","last_change":"2024-04-25T15:30:35.695421+0000","last_active":"2024-04-25T15:30:36.820687+0000","last_peered":"2024-04-25T15:30:36.820687+0000","last_clean":"2024-04-25T15:30:36.820687+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:30:36.820687+0000","last_undegraded":"2024-04-25T15:30:36.820687+0000","last_fullsized":"2024-04-25T15:30:36.820687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:32.390382+0000","scrub_duration":0,"objects_trimmed":254,"snaptrim_duration":5.1020456789999997,"stat_sum":{"num_bytes":2772,"num_objects":464,"num_object_clones":232,"num_object_copies":928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":464,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.31","version":"41'3614","reported_seq":2868,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.818073+0000","last_change":"2024-04-25T15:30:37.608682+0000","last_active":"2024-04-25T15:30:39.818073+0000","last_peered":"2024-04-25T15:30:39.818073+0000","last_clean":"2024-04-25T15:30:39.818073+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:30:39.818073+0000","last_undegraded":"2024-04-25T15:30:39.818073+0000","last_fullsized":"2024-04-25T15:30:39.818073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.286828+0000","scrub_duration":0,"objects_trimmed":718,"snaptrim_duration":3.3798137829999999,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.30","version":"41'3345","reported_seq":2704,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.805396+0000","last_change":"2024-04-25T15:30:39.550459+0000","last_active":"2024-04-25T15:30:39.805396+0000","last_peered":"2024-04-25T15:30:39.805396+0000","last_clean":"2024-04-25T15:30:39.805396+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:30:39.805396+0000","last_undegraded":"2024-04-25T15:30:39.805396+0000","last_fullsized":"2024-04-25T15:30:39.805396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3345,"log_dups_size":0,"ondisk_log_size":3345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:14.294299+0000","scrub_duration":0,"objects_trimmed":309,"snaptrim_duration":3.23396032,"stat_sum":{"num_bytes":2340,"num_objects":395,"num_object_clones":196,"num_object_copies":790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":196,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2f","version":"41'3039","reported_seq":2454,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.765443+0000","last_change":"2024-04-25T15:30:35.194447+0000","last_active":"2024-04-25T15:30:36.765443+0000","last_peered":"2024-04-25T15:30:36.765443+0000","last_clean":"2024-04-25T15:30:36.765443+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:30:36.765443+0000","last_undegraded":"2024-04-25T15:30:36.765443+0000","last_fullsized":"2024-04-25T15:30:36.765443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3039,"log_dups_size":0,"ondisk_log_size":3039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:25.180751+0000","scrub_duration":0,"objects_trimmed":267,"snaptrim_duration":4.6003804729999995,"stat_sum":{"num_bytes":7115,"num_objects":503,"num_object_clones":250,"num_object_copies":1006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":503,"num_whiteouts":249,"num_read":29,"num_read_kb":23,"num_write":1332,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2e","version":"41'3381","reported_seq":2767,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.293789+0000","last_change":"2024-04-25T15:30:37.294444+0000","last_active":"2024-04-25T15:30:37.293789+0000","last_peered":"2024-04-25T15:30:37.293789+0000","last_clean":"2024-04-25T15:30:37.293789+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:30:37.293789+0000","last_undegraded":"2024-04-25T15:30:37.293789+0000","last_fullsized":"2024-04-25T15:30:37.293789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3381,"log_dups_size":0,"ondisk_log_size":3381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:39.283655+0000","scrub_duration":0,"objects_trimmed":607,"snaptrim_duration":6.6868273169999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1074,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.2d","version":"41'2935","reported_seq":2377,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.769129+0000","last_change":"2024-04-25T15:30:34.823111+0000","last_active":"2024-04-25T15:30:36.769129+0000","last_peered":"2024-04-25T15:30:36.769129+0000","last_clean":"2024-04-25T15:30:36.769129+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:30:36.769129+0000","last_undegraded":"2024-04-25T15:30:36.769129+0000","last_fullsized":"2024-04-25T15:30:36.769129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":0,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.008764+0000","scrub_duration":0,"objects_trimmed":241,"snaptrim_duration":4.2245572769999997,"stat_sum":{"num_bytes":10796,"num_objects":437,"num_object_clones":217,"num_object_copies":874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":437,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2c","version":"41'3637","reported_seq":2956,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.782864+0000","last_change":"2024-04-25T15:30:38.584170+0000","last_active":"2024-04-25T15:30:39.782864+0000","last_peered":"2024-04-25T15:30:39.782864+0000","last_clean":"2024-04-25T15:30:39.782864+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:30:39.782864+0000","last_undegraded":"2024-04-25T15:30:39.782864+0000","last_fullsized":"2024-04-25T15:30:39.782864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3637,"log_dups_size":0,"ondisk_log_size":3637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.188818+0000","scrub_duration":0,"objects_trimmed":675,"snaptrim_duration":4.527686181,"stat_sum":{"num_bytes":4381,"num_objects":48,"num_object_clones":23,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":23,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2b","version":"41'2589","reported_seq":2125,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.840738+0000","last_change":"2024-04-25T15:30:39.261980+0000","last_active":"2024-04-25T15:30:39.840738+0000","last_peered":"2024-04-25T15:30:39.840738+0000","last_clean":"2024-04-25T15:30:39.840738+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:30:39.840738+0000","last_undegraded":"2024-04-25T15:30:39.840738+0000","last_fullsized":"2024-04-25T15:30:39.840738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2589,"log_dups_size":0,"ondisk_log_size":2589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:25.180751+0000","scrub_duration":0,"objects_trimmed":93,"snaptrim_duration":2.5085498839999998,"stat_sum":{"num_bytes":12295,"num_objects":576,"num_object_clones":353,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":576,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"41'3477","reported_seq":2811,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.369522+0000","last_change":"2024-04-25T15:30:38.369568+0000","last_active":"2024-04-25T15:30:38.369522+0000","last_peered":"2024-04-25T15:30:38.369522+0000","last_clean":"2024-04-25T15:30:38.369522+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:30:38.369522+0000","last_undegraded":"2024-04-25T15:30:38.369522+0000","last_fullsized":"2024-04-25T15:30:38.369522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3477,"log_dups_size":0,"ondisk_log_size":3477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:38.889747+0000","scrub_duration":0,"objects_trimmed":279,"snaptrim_duration":7.7756122369999998,"stat_sum":{"num_bytes":2988,"num_objects":499,"num_object_clones":249,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":249,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.29","version":"41'2839","reported_seq":2307,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.771891+0000","last_change":"2024-04-25T15:30:38.771953+0000","last_active":"2024-04-25T15:30:38.771891+0000","last_peered":"2024-04-25T15:30:38.771891+0000","last_clean":"2024-04-25T15:30:38.771891+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:30:38.771891+0000","last_undegraded":"2024-04-25T15:30:38.771891+0000","last_fullsized":"2024-04-25T15:30:38.771891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:19.962755+0000","scrub_duration":0,"objects_trimmed":234,"snaptrim_duration":8.1826379809999992,"stat_sum":{"num_bytes":2688,"num_objects":448,"num_object_clones":224,"num_object_copies":896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":448,"num_whiteouts":224,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.28","version":"41'3870","reported_seq":3072,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.688276+0000","last_change":"2024-04-25T15:30:39.688338+0000","last_active":"2024-04-25T15:30:39.688276+0000","last_peered":"2024-04-25T15:30:39.688276+0000","last_clean":"2024-04-25T15:30:39.688276+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:30:39.688276+0000","last_undegraded":"2024-04-25T15:30:39.688276+0000","last_fullsized":"2024-04-25T15:30:39.688276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:50.436650+0000","scrub_duration":0,"objects_trimmed":736,"snaptrim_duration":9.0947790669999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.27","version":"41'2706","reported_seq":2190,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.756049+0000","last_change":"2024-04-25T15:30:34.264406+0000","last_active":"2024-04-25T15:30:36.756049+0000","last_peered":"2024-04-25T15:30:36.756049+0000","last_clean":"2024-04-25T15:30:36.756049+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:30:36.756049+0000","last_undegraded":"2024-04-25T15:30:36.756049+0000","last_fullsized":"2024-04-25T15:30:36.756049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2706,"log_dups_size":0,"ondisk_log_size":2706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:12.255072+0000","scrub_duration":0,"objects_trimmed":221,"snaptrim_duration":3.675183461,"stat_sum":{"num_bytes":2508,"num_objects":420,"num_object_clones":210,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":210,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.26","version":"41'3511","reported_seq":2842,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.082124+0000","last_change":"2024-04-25T15:30:39.082167+0000","last_active":"2024-04-25T15:30:39.082124+0000","last_peered":"2024-04-25T15:30:39.082124+0000","last_clean":"2024-04-25T15:30:39.082124+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:30:39.082124+0000","last_undegraded":"2024-04-25T15:30:39.082124+0000","last_fullsized":"2024-04-25T15:30:39.082124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:34.715196+0000","scrub_duration":0,"objects_trimmed":665,"snaptrim_duration":8.4792293389999998,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.25","version":"41'3084","reported_seq":2454,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.813596+0000","last_change":"2024-04-25T15:30:35.728684+0000","last_active":"2024-04-25T15:30:36.813596+0000","last_peered":"2024-04-25T15:30:36.813596+0000","last_clean":"2024-04-25T15:30:36.813596+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:30:36.813596+0000","last_undegraded":"2024-04-25T15:30:36.813596+0000","last_fullsized":"2024-04-25T15:30:36.813596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:34.715196+0000","scrub_duration":0,"objects_trimmed":236,"snaptrim_duration":5.1279696599999998,"stat_sum":{"num_bytes":6736,"num_objects":442,"num_object_clones":220,"num_object_copies":884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.24","version":"41'2870","reported_seq":2298,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.400954+0000","last_change":"2024-04-25T15:30:39.401000+0000","last_active":"2024-04-25T15:30:39.400954+0000","last_peered":"2024-04-25T15:30:39.400954+0000","last_clean":"2024-04-25T15:30:39.400954+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:30:39.400954+0000","last_undegraded":"2024-04-25T15:30:39.400954+0000","last_fullsized":"2024-04-25T15:30:39.400954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2870,"log_dups_size":0,"ondisk_log_size":2870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:42.101503+0000","scrub_duration":0,"objects_trimmed":228,"snaptrim_duration":8.8116670890000002,"stat_sum":{"num_bytes":2568,"num_objects":429,"num_object_clones":214,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":429,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.23","version":"41'2974","reported_seq":2391,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.089089+0000","last_change":"2024-04-25T15:30:38.089128+0000","last_active":"2024-04-25T15:30:38.089089+0000","last_peered":"2024-04-25T15:30:38.089089+0000","last_clean":"2024-04-25T15:30:38.089089+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:30:38.089089+0000","last_undegraded":"2024-04-25T15:30:38.089089+0000","last_fullsized":"2024-04-25T15:30:38.089089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2974,"log_dups_size":0,"ondisk_log_size":2974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:08.750880+0000","scrub_duration":0,"objects_trimmed":255,"snaptrim_duration":7.4951841339999996,"stat_sum":{"num_bytes":6940,"num_objects":475,"num_object_clones":237,"num_object_copies":950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":237,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.22","version":"41'3138","reported_seq":2509,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.299277+0000","last_change":"2024-04-25T15:30:37.300211+0000","last_active":"2024-04-25T15:30:37.299277+0000","last_peered":"2024-04-25T15:30:37.299277+0000","last_clean":"2024-04-25T15:30:37.299277+0000","last_became_active":"2024-04-25T15:21:23.859850+0000","last_became_peered":"2024-04-25T15:21:23.859850+0000","last_unstale":"2024-04-25T15:30:37.299277+0000","last_undegraded":"2024-04-25T15:30:37.299277+0000","last_fullsized":"2024-04-25T15:30:37.299277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3138,"log_dups_size":0,"ondisk_log_size":3138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:29:49.950843+0000","scrub_duration":0,"objects_trimmed":606,"snaptrim_duration":6.6890380110000001,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.21","version":"41'4292","reported_seq":3407,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.296102+0000","last_change":"2024-04-25T15:30:37.296764+0000","last_active":"2024-04-25T15:30:37.296102+0000","last_peered":"2024-04-25T15:30:37.296102+0000","last_clean":"2024-04-25T15:30:37.296102+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:30:37.296102+0000","last_undegraded":"2024-04-25T15:30:37.296102+0000","last_fullsized":"2024-04-25T15:30:37.296102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":4292,"log_dups_size":0,"ondisk_log_size":4292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:20.083988+0000","scrub_duration":0,"objects_trimmed":828,"snaptrim_duration":6.6887649839999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1392,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.20","version":"41'3875","reported_seq":3100,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.584094+0000","last_change":"2024-04-25T15:30:38.584137+0000","last_active":"2024-04-25T15:30:38.584094+0000","last_peered":"2024-04-25T15:30:38.584094+0000","last_clean":"2024-04-25T15:30:38.584094+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:30:38.584094+0000","last_undegraded":"2024-04-25T15:30:38.584094+0000","last_fullsized":"2024-04-25T15:30:38.584094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3875,"log_dups_size":0,"ondisk_log_size":3875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:27.011814+0000","scrub_duration":0,"objects_trimmed":743,"snaptrim_duration":7.9821429300000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.1a","version":"41'3757","reported_seq":2998,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676006+0000","last_change":"2024-04-25T15:30:38.676214+0000","last_active":"2024-04-25T15:30:38.676006+0000","last_peered":"2024-04-25T15:30:38.676006+0000","last_clean":"2024-04-25T15:30:38.676006+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:30:38.676006+0000","last_undegraded":"2024-04-25T15:30:38.676006+0000","last_fullsized":"2024-04-25T15:30:38.676006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:32.184227+0000","scrub_duration":0,"objects_trimmed":718,"snaptrim_duration":8.0786759789999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.1b","version":"40'3208","reported_seq":3267,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589972+0000","last_change":"2024-04-25T15:20:41.411834+0000","last_active":"2024-04-25T15:30:30.589972+0000","last_peered":"2024-04-25T15:30:30.589972+0000","last_clean":"2024-04-25T15:30:30.589972+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:30:30.589972+0000","last_undegraded":"2024-04-25T15:30:30.589972+0000","last_fullsized":"2024-04-25T15:30:30.589972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":3284,"num_write_kb":9502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"41'2975","reported_seq":2406,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.797633+0000","last_change":"2024-04-25T15:30:39.797773+0000","last_active":"2024-04-25T15:30:39.797633+0000","last_peered":"2024-04-25T15:30:39.797633+0000","last_clean":"2024-04-25T15:30:39.797633+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:30:39.797633+0000","last_undegraded":"2024-04-25T15:30:39.797633+0000","last_fullsized":"2024-04-25T15:30:39.797633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2975,"log_dups_size":0,"ondisk_log_size":2975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:50.436650+0000","scrub_duration":0,"objects_trimmed":257,"snaptrim_duration":9.2035530340000005,"stat_sum":{"num_bytes":2940,"num_objects":491,"num_object_clones":245,"num_object_copies":982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":491,"num_whiteouts":245,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1a","version":"40'6006","reported_seq":6065,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602379+0000","last_change":"2024-04-25T15:20:41.401581+0000","last_active":"2024-04-25T15:30:30.602379+0000","last_peered":"2024-04-25T15:30:30.602379+0000","last_clean":"2024-04-25T15:30:30.602379+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:30:30.602379+0000","last_undegraded":"2024-04-25T15:30:30.602379+0000","last_fullsized":"2024-04-25T15:30:30.602379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6006,"log_dups_size":0,"ondisk_log_size":6006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":6066,"num_write_kb":31066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"40'881","reported_seq":941,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589144+0000","last_change":"2024-04-25T15:20:41.404692+0000","last_active":"2024-04-25T15:30:30.589144+0000","last_peered":"2024-04-25T15:30:30.589144+0000","last_clean":"2024-04-25T15:30:30.589144+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:30:30.589144+0000","last_undegraded":"2024-04-25T15:30:30.589144+0000","last_fullsized":"2024-04-25T15:30:30.589144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":944,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"41'3300","reported_seq":2631,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.856467+0000","last_change":"2024-04-25T15:30:34.747823+0000","last_active":"2024-04-25T15:30:36.856467+0000","last_peered":"2024-04-25T15:30:36.856467+0000","last_clean":"2024-04-25T15:30:36.856467+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:30:36.856467+0000","last_undegraded":"2024-04-25T15:30:36.856467+0000","last_fullsized":"2024-04-25T15:30:36.856467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:35.107011+0000","scrub_duration":0,"objects_trimmed":282,"snaptrim_duration":4.1586895349999997,"stat_sum":{"num_bytes":3227,"num_objects":540,"num_object_clones":269,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":269,"num_read":0,"num_read_kb":0,"num_write":1372,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.18","version":"40'3115","reported_seq":3175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593773+0000","last_change":"2024-04-25T15:20:41.406208+0000","last_active":"2024-04-25T15:30:30.593773+0000","last_peered":"2024-04-25T15:30:30.593773+0000","last_clean":"2024-04-25T15:30:30.593773+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:30:30.593773+0000","last_undegraded":"2024-04-25T15:30:30.593773+0000","last_fullsized":"2024-04-25T15:30:30.593773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3115,"log_dups_size":0,"ondisk_log_size":3115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3188,"num_write_kb":38703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"41'3651","reported_seq":2949,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.749771+0000","last_change":"2024-04-25T15:30:38.749822+0000","last_active":"2024-04-25T15:30:38.749771+0000","last_peered":"2024-04-25T15:30:38.749771+0000","last_clean":"2024-04-25T15:30:38.749771+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:30:38.749771+0000","last_undegraded":"2024-04-25T15:30:38.749771+0000","last_fullsized":"2024-04-25T15:30:38.749771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3651,"log_dups_size":0,"ondisk_log_size":3651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:27.011814+0000","scrub_duration":0,"objects_trimmed":658,"snaptrim_duration":8.1500825540000008,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.17","version":"40'1109","reported_seq":1169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602496+0000","last_change":"2024-04-25T15:20:41.406067+0000","last_active":"2024-04-25T15:30:30.602496+0000","last_peered":"2024-04-25T15:30:30.602496+0000","last_clean":"2024-04-25T15:30:30.602496+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:30:30.602496+0000","last_undegraded":"2024-04-25T15:30:30.602496+0000","last_fullsized":"2024-04-25T15:30:30.602496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1182,"num_write_kb":13307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"41'2914","reported_seq":2378,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.797642+0000","last_change":"2024-04-25T15:30:35.649216+0000","last_active":"2024-04-25T15:30:36.797642+0000","last_peered":"2024-04-25T15:30:36.797642+0000","last_clean":"2024-04-25T15:30:36.797642+0000","last_became_active":"2024-04-25T15:21:23.536519+0000","last_became_peered":"2024-04-25T15:21:23.536519+0000","last_unstale":"2024-04-25T15:30:36.797642+0000","last_undegraded":"2024-04-25T15:30:36.797642+0000","last_fullsized":"2024-04-25T15:30:36.797642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2914,"log_dups_size":0,"ondisk_log_size":2914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.188818+0000","scrub_duration":0,"objects_trimmed":229,"snaptrim_duration":5.0480612520000001,"stat_sum":{"num_bytes":6676,"num_objects":432,"num_object_clones":215,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":215,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.16","version":"40'1813","reported_seq":1873,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593511+0000","last_change":"2024-04-25T15:20:41.410325+0000","last_active":"2024-04-25T15:30:30.593511+0000","last_peered":"2024-04-25T15:30:30.593511+0000","last_clean":"2024-04-25T15:30:30.593511+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:30:30.593511+0000","last_undegraded":"2024-04-25T15:30:30.593511+0000","last_fullsized":"2024-04-25T15:30:30.593511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1874,"num_write_kb":25731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"41'3084","reported_seq":2484,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.796302+0000","last_change":"2024-04-25T15:30:34.106253+0000","last_active":"2024-04-25T15:30:36.796302+0000","last_peered":"2024-04-25T15:30:36.796302+0000","last_clean":"2024-04-25T15:30:36.796302+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:30:36.796302+0000","last_undegraded":"2024-04-25T15:30:36.796302+0000","last_fullsized":"2024-04-25T15:30:36.796302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:46:23.746310+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":3.513388913,"stat_sum":{"num_bytes":2839,"num_objects":470,"num_object_clones":235,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":234,"num_read":3,"num_read_kb":2,"num_write":1199,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.15","version":"40'3249","reported_seq":3308,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600801+0000","last_change":"2024-04-25T15:20:41.415893+0000","last_active":"2024-04-25T15:30:30.600801+0000","last_peered":"2024-04-25T15:30:30.600801+0000","last_clean":"2024-04-25T15:30:30.600801+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:30:30.600801+0000","last_undegraded":"2024-04-25T15:30:30.600801+0000","last_fullsized":"2024-04-25T15:30:30.600801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3249,"log_dups_size":0,"ondisk_log_size":3249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3319,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'3965","reported_seq":3179,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676280+0000","last_change":"2024-04-25T15:30:38.676764+0000","last_active":"2024-04-25T15:30:38.676280+0000","last_peered":"2024-04-25T15:30:38.676280+0000","last_clean":"2024-04-25T15:30:38.676280+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:30:38.676280+0000","last_undegraded":"2024-04-25T15:30:38.676280+0000","last_fullsized":"2024-04-25T15:30:38.676280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3965,"log_dups_size":0,"ondisk_log_size":3965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:50.458209+0000","scrub_duration":0,"objects_trimmed":757,"snaptrim_duration":8.0786606909999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.14","version":"41'5275","reported_seq":5335,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.604978+0000","last_change":"2024-04-25T15:20:41.406750+0000","last_active":"2024-04-25T15:30:30.604978+0000","last_peered":"2024-04-25T15:30:30.604978+0000","last_clean":"2024-04-25T15:30:30.604978+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:30:30.604978+0000","last_undegraded":"2024-04-25T15:30:30.604978+0000","last_fullsized":"2024-04-25T15:30:30.604978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":5332,"num_write_kb":30677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"41'3520","reported_seq":2810,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.829353+0000","last_change":"2024-04-25T15:30:38.877873+0000","last_active":"2024-04-25T15:30:39.829353+0000","last_peered":"2024-04-25T15:30:39.829353+0000","last_clean":"2024-04-25T15:30:39.829353+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:30:39.829353+0000","last_undegraded":"2024-04-25T15:30:39.829353+0000","last_fullsized":"2024-04-25T15:30:39.829353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:40.123031+0000","scrub_duration":0,"objects_trimmed":598,"snaptrim_duration":1.615482919,"stat_sum":{"num_bytes":696,"num_objects":118,"num_object_clones":59,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":59,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.13","version":"40'2601","reported_seq":2661,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.594170+0000","last_change":"2024-04-25T15:20:41.401705+0000","last_active":"2024-04-25T15:30:30.594170+0000","last_peered":"2024-04-25T15:30:30.594170+0000","last_clean":"2024-04-25T15:30:30.594170+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:30:30.594170+0000","last_undegraded":"2024-04-25T15:30:30.594170+0000","last_fullsized":"2024-04-25T15:30:30.594170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":2688,"num_write_kb":17973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"41'2843","reported_seq":2289,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.820025+0000","last_change":"2024-04-25T15:30:36.212116+0000","last_active":"2024-04-25T15:30:36.820025+0000","last_peered":"2024-04-25T15:30:36.820025+0000","last_clean":"2024-04-25T15:30:36.820025+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:30:36.820025+0000","last_undegraded":"2024-04-25T15:30:36.820025+0000","last_fullsized":"2024-04-25T15:30:36.820025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2843,"log_dups_size":0,"ondisk_log_size":2843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:57.104366+0000","scrub_duration":0,"objects_trimmed":240,"snaptrim_duration":5.6185218160000003,"stat_sum":{"num_bytes":2729,"num_objects":450,"num_object_clones":225,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":224,"num_read":4,"num_read_kb":3,"num_write":1228,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.12","version":"40'111","reported_seq":171,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593646+0000","last_change":"2024-04-25T15:20:41.409212+0000","last_active":"2024-04-25T15:30:30.593646+0000","last_peered":"2024-04-25T15:30:30.593646+0000","last_clean":"2024-04-25T15:30:30.593646+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:30:30.593646+0000","last_undegraded":"2024-04-25T15:30:30.593646+0000","last_fullsized":"2024-04-25T15:30:30.593646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":196,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"41'3627","reported_seq":2962,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.763179+0000","last_change":"2024-04-25T15:30:36.524583+0000","last_active":"2024-04-25T15:30:36.763179+0000","last_peered":"2024-04-25T15:30:36.763179+0000","last_clean":"2024-04-25T15:30:36.763179+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:30:36.763179+0000","last_undegraded":"2024-04-25T15:30:36.763179+0000","last_fullsized":"2024-04-25T15:30:36.763179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:43.450201+0000","scrub_duration":0,"objects_trimmed":264,"snaptrim_duration":5.9252819609999996,"stat_sum":{"num_bytes":2963,"num_objects":495,"num_object_clones":247,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":246,"num_read":0,"num_read_kb":0,"num_write":1302,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.11","version":"40'1074","reported_seq":1134,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602130+0000","last_change":"2024-04-25T15:20:41.402015+0000","last_active":"2024-04-25T15:30:30.602130+0000","last_peered":"2024-04-25T15:30:30.602130+0000","last_clean":"2024-04-25T15:30:30.602130+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:30:30.602130+0000","last_undegraded":"2024-04-25T15:30:30.602130+0000","last_fullsized":"2024-04-25T15:30:30.602130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1158,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"41'3313","reported_seq":2636,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.788145+0000","last_change":"2024-04-25T15:30:39.082197+0000","last_active":"2024-04-25T15:30:39.788145+0000","last_peered":"2024-04-25T15:30:39.788145+0000","last_clean":"2024-04-25T15:30:39.788145+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:30:39.788145+0000","last_undegraded":"2024-04-25T15:30:39.788145+0000","last_fullsized":"2024-04-25T15:30:39.788145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:52.269365+0000","scrub_duration":0,"objects_trimmed":483,"snaptrim_duration":5.3086005309999997,"stat_sum":{"num_bytes":1128,"num_objects":188,"num_object_clones":94,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":94,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.10","version":"40'1015","reported_seq":1074,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.607771+0000","last_change":"2024-04-25T15:20:41.408427+0000","last_active":"2024-04-25T15:30:30.607771+0000","last_peered":"2024-04-25T15:30:30.607771+0000","last_clean":"2024-04-25T15:30:30.607771+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:30:30.607771+0000","last_undegraded":"2024-04-25T15:30:30.607771+0000","last_fullsized":"2024-04-25T15:30:30.607771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1107,"num_write_kb":8933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"41'3012","reported_seq":2410,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.813421+0000","last_change":"2024-04-25T15:30:34.399393+0000","last_active":"2024-04-25T15:30:36.813421+0000","last_peered":"2024-04-25T15:30:36.813421+0000","last_clean":"2024-04-25T15:30:36.813421+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:30:36.813421+0000","last_undegraded":"2024-04-25T15:30:36.813421+0000","last_fullsized":"2024-04-25T15:30:36.813421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3012,"log_dups_size":0,"ondisk_log_size":3012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:38.071652+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":3.8010930269999998,"stat_sum":{"num_bytes":2784,"num_objects":467,"num_object_clones":232,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.f","version":"40'1305","reported_seq":1365,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.597526+0000","last_change":"2024-04-25T15:20:41.405515+0000","last_active":"2024-04-25T15:30:30.597526+0000","last_peered":"2024-04-25T15:30:30.597526+0000","last_clean":"2024-04-25T15:30:30.597526+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:30:30.597526+0000","last_undegraded":"2024-04-25T15:30:30.597526+0000","last_fullsized":"2024-04-25T15:30:30.597526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1305,"log_dups_size":0,"ondisk_log_size":1305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":1351,"num_write_kb":8728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"41'3157","reported_seq":2502,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.076092+0000","last_change":"2024-04-25T15:30:38.076135+0000","last_active":"2024-04-25T15:30:38.076092+0000","last_peered":"2024-04-25T15:30:38.076092+0000","last_clean":"2024-04-25T15:30:38.076092+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:30:38.076092+0000","last_undegraded":"2024-04-25T15:30:38.076092+0000","last_fullsized":"2024-04-25T15:30:38.076092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3157,"log_dups_size":0,"ondisk_log_size":3157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:57.855461+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":7.4762973989999999,"stat_sum":{"num_bytes":2894,"num_objects":483,"num_object_clones":240,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":483,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.e","version":"40'2474","reported_seq":2533,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.607786+0000","last_change":"2024-04-25T15:20:41.406806+0000","last_active":"2024-04-25T15:30:30.607786+0000","last_peered":"2024-04-25T15:30:30.607786+0000","last_clean":"2024-04-25T15:30:30.607786+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:30:30.607786+0000","last_undegraded":"2024-04-25T15:30:30.607786+0000","last_fullsized":"2024-04-25T15:30:30.607786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2474,"log_dups_size":0,"ondisk_log_size":2474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2548,"num_write_kb":13580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"41'2993","reported_seq":2435,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.508105+0000","last_change":"2024-04-25T15:30:39.508145+0000","last_active":"2024-04-25T15:30:39.508105+0000","last_peered":"2024-04-25T15:30:39.508105+0000","last_clean":"2024-04-25T15:30:39.508105+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:30:39.508105+0000","last_undegraded":"2024-04-25T15:30:39.508105+0000","last_fullsized":"2024-04-25T15:30:39.508105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2993,"log_dups_size":0,"ondisk_log_size":2993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:39:13.576915+0000","scrub_duration":0,"objects_trimmed":250,"snaptrim_duration":8.9069907399999995,"stat_sum":{"num_bytes":6889,"num_objects":467,"num_object_clones":232,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":231,"num_read":2,"num_read_kb":1,"num_write":1224,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.d","version":"40'4442","reported_seq":4501,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600901+0000","last_change":"2024-04-25T15:20:41.410562+0000","last_active":"2024-04-25T15:30:30.600901+0000","last_peered":"2024-04-25T15:30:30.600901+0000","last_clean":"2024-04-25T15:30:30.600901+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:30:30.600901+0000","last_undegraded":"2024-04-25T15:30:30.600901+0000","last_fullsized":"2024-04-25T15:30:30.600901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583135,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":4527,"num_write_kb":26836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"41'3079","reported_seq":2481,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.081368+0000","last_change":"2024-04-25T15:30:37.081413+0000","last_active":"2024-04-25T15:30:37.081368+0000","last_peered":"2024-04-25T15:30:37.081368+0000","last_clean":"2024-04-25T15:30:37.081368+0000","last_became_active":"2024-04-25T15:21:23.537569+0000","last_became_peered":"2024-04-25T15:21:23.537569+0000","last_unstale":"2024-04-25T15:30:37.081368+0000","last_undegraded":"2024-04-25T15:30:37.081368+0000","last_fullsized":"2024-04-25T15:30:37.081368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3079,"log_dups_size":0,"ondisk_log_size":3079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:57.114192+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":6.4871342199999997,"stat_sum":{"num_bytes":2760,"num_objects":462,"num_object_clones":230,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":462,"num_whiteouts":230,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.c","version":"40'2074","reported_seq":2133,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.611756+0000","last_change":"2024-04-25T15:20:41.404065+0000","last_active":"2024-04-25T15:30:30.611756+0000","last_peered":"2024-04-25T15:30:30.611756+0000","last_clean":"2024-04-25T15:30:30.611756+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:30:30.611756+0000","last_undegraded":"2024-04-25T15:30:30.611756+0000","last_fullsized":"2024-04-25T15:30:30.611756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":2143,"num_write_kb":17826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'3058","reported_seq":2449,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.782748+0000","last_change":"2024-04-25T15:30:33.086094+0000","last_active":"2024-04-25T15:30:36.782748+0000","last_peered":"2024-04-25T15:30:36.782748+0000","last_clean":"2024-04-25T15:30:36.782748+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:30:36.782748+0000","last_undegraded":"2024-04-25T15:30:36.782748+0000","last_fullsized":"2024-04-25T15:30:36.782748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:16.090008+0000","scrub_duration":0,"objects_trimmed":246,"snaptrim_duration":2.487939248,"stat_sum":{"num_bytes":6832,"num_objects":457,"num_object_clones":228,"num_object_copies":914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602229+0000","last_change":"2024-04-25T15:20:30.873208+0000","last_active":"2024-04-25T15:30:30.602229+0000","last_peered":"2024-04-25T15:30:30.602229+0000","last_clean":"2024-04-25T15:30:30.602229+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:30:30.602229+0000","last_undegraded":"2024-04-25T15:30:30.602229+0000","last_fullsized":"2024-04-25T15:30:30.602229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_clean_scrub_stamp":"2024-04-25T15:20:29.835147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:59.356200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"40'1171","reported_seq":1231,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593277+0000","last_change":"2024-04-25T15:20:41.403922+0000","last_active":"2024-04-25T15:30:30.593277+0000","last_peered":"2024-04-25T15:30:30.593277+0000","last_clean":"2024-04-25T15:30:30.593277+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:30:30.593277+0000","last_undegraded":"2024-04-25T15:30:30.593277+0000","last_fullsized":"2024-04-25T15:30:30.593277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1252,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"41'2570","reported_seq":2122,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.823536+0000","last_change":"2024-04-25T15:30:30.590019+0000","last_active":"2024-04-25T15:30:36.823536+0000","last_peered":"2024-04-25T15:30:36.823536+0000","last_clean":"2024-04-25T15:30:36.823536+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:30:36.823536+0000","last_undegraded":"2024-04-25T15:30:36.823536+0000","last_fullsized":"2024-04-25T15:30:36.823536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2570,"log_dups_size":0,"ondisk_log_size":2570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:33.739781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.6625848130000001,"stat_sum":{"num_bytes":5283,"num_objects":698,"num_object_clones":460,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":698,"num_whiteouts":237,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"41'3615","reported_seq":3675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:36.643537+0000","last_change":"2024-04-25T15:20:41.410568+0000","last_active":"2024-04-25T15:30:36.643537+0000","last_peered":"2024-04-25T15:30:36.643537+0000","last_clean":"2024-04-25T15:30:36.643537+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:30:36.643537+0000","last_undegraded":"2024-04-25T15:30:36.643537+0000","last_fullsized":"2024-04-25T15:30:36.643537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6520497,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":3670,"num_write_kb":20386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"41'3126","reported_seq":2493,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.769564+0000","last_change":"2024-04-25T15:30:33.021932+0000","last_active":"2024-04-25T15:30:36.769564+0000","last_peered":"2024-04-25T15:30:36.769564+0000","last_clean":"2024-04-25T15:30:36.769564+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:30:36.769564+0000","last_undegraded":"2024-04-25T15:30:36.769564+0000","last_fullsized":"2024-04-25T15:30:36.769564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3126,"log_dups_size":0,"ondisk_log_size":3126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:46.761461+0000","scrub_duration":0,"objects_trimmed":238,"snaptrim_duration":2.4295429180000001,"stat_sum":{"num_bytes":2760,"num_objects":460,"num_object_clones":230,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":460,"num_whiteouts":230,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1","version":"40'2374","reported_seq":2747,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.608333+0000","last_change":"2024-04-25T15:20:41.406046+0000","last_active":"2024-04-25T15:30:30.608333+0000","last_peered":"2024-04-25T15:30:30.608333+0000","last_clean":"2024-04-25T15:30:30.608333+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:30:30.608333+0000","last_undegraded":"2024-04-25T15:30:30.608333+0000","last_fullsized":"2024-04-25T15:30:30.608333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2374,"log_dups_size":0,"ondisk_log_size":2374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11691863,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":329,"num_read_kb":3430,"num_write":2430,"num_write_kb":16848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"41'3413","reported_seq":2728,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.608544+0000","last_change":"2024-04-25T15:30:37.608587+0000","last_active":"2024-04-25T15:30:37.608544+0000","last_peered":"2024-04-25T15:30:37.608544+0000","last_clean":"2024-04-25T15:30:37.608544+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:30:37.608544+0000","last_undegraded":"2024-04-25T15:30:37.608544+0000","last_fullsized":"2024-04-25T15:30:37.608544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:20.257648+0000","scrub_duration":0,"objects_trimmed":723,"snaptrim_duration":7.0088171780000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.2","version":"40'6781","reported_seq":6841,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.594013+0000","last_change":"2024-04-25T15:20:41.410676+0000","last_active":"2024-04-25T15:30:30.594013+0000","last_peered":"2024-04-25T15:30:30.594013+0000","last_clean":"2024-04-25T15:30:30.594013+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:30:30.594013+0000","last_undegraded":"2024-04-25T15:30:30.594013+0000","last_fullsized":"2024-04-25T15:30:30.594013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6781,"log_dups_size":0,"ondisk_log_size":6781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":6828,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"41'3641","reported_seq":2884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676561+0000","last_change":"2024-04-25T15:30:38.676800+0000","last_active":"2024-04-25T15:30:38.676561+0000","last_peered":"2024-04-25T15:30:38.676561+0000","last_clean":"2024-04-25T15:30:38.676561+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:30:38.676561+0000","last_undegraded":"2024-04-25T15:30:38.676561+0000","last_fullsized":"2024-04-25T15:30:38.676561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.134412+0000","scrub_duration":0,"objects_trimmed":737,"snaptrim_duration":8.0788980660000007,"stat_sum":{"num_bytes":21,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1263,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.4","version":"40'144","reported_seq":203,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599943+0000","last_change":"2024-04-25T15:20:41.413703+0000","last_active":"2024-04-25T15:30:30.599943+0000","last_peered":"2024-04-25T15:30:30.599943+0000","last_clean":"2024-04-25T15:30:30.599943+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:30:30.599943+0000","last_undegraded":"2024-04-25T15:30:30.599943+0000","last_fullsized":"2024-04-25T15:30:30.599943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":208,"num_write_kb":8700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"41'2817","reported_seq":2279,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.562635+0000","last_change":"2024-04-25T15:30:37.562677+0000","last_active":"2024-04-25T15:30:37.562635+0000","last_peered":"2024-04-25T15:30:37.562635+0000","last_clean":"2024-04-25T15:30:37.562635+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:30:37.562635+0000","last_undegraded":"2024-04-25T15:30:37.562635+0000","last_fullsized":"2024-04-25T15:30:37.562635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2817,"log_dups_size":0,"ondisk_log_size":2817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:53.738899+0000","scrub_duration":0,"objects_trimmed":229,"snaptrim_duration":6.9682819660000002,"stat_sum":{"num_bytes":10772,"num_objects":435,"num_object_clones":217,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":216,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.5","version":"40'1973","reported_seq":2033,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598648+0000","last_change":"2024-04-25T15:20:41.408759+0000","last_active":"2024-04-25T15:30:30.598648+0000","last_peered":"2024-04-25T15:30:30.598648+0000","last_clean":"2024-04-25T15:30:30.598648+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:30:30.598648+0000","last_undegraded":"2024-04-25T15:30:30.598648+0000","last_fullsized":"2024-04-25T15:30:30.598648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1973,"log_dups_size":0,"ondisk_log_size":1973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:41.992733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2030,"num_write_kb":21675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"41'3370","reported_seq":2703,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.816380+0000","last_change":"2024-04-25T15:30:38.749936+0000","last_active":"2024-04-25T15:30:39.816380+0000","last_peered":"2024-04-25T15:30:39.816380+0000","last_clean":"2024-04-25T15:30:39.816380+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:30:39.816380+0000","last_undegraded":"2024-04-25T15:30:39.816380+0000","last_fullsized":"2024-04-25T15:30:39.816380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:26.387482+0000","scrub_duration":0,"objects_trimmed":590,"snaptrim_duration":3.4419109580000002,"stat_sum":{"num_bytes":600,"num_objects":102,"num_object_clones":51,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":51,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.6","version":"41'2504","reported_seq":2563,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.601549+0000","last_change":"2024-04-25T15:20:41.409877+0000","last_active":"2024-04-25T15:30:30.601549+0000","last_peered":"2024-04-25T15:30:30.601549+0000","last_clean":"2024-04-25T15:30:30.601549+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:30:30.601549+0000","last_undegraded":"2024-04-25T15:30:30.601549+0000","last_fullsized":"2024-04-25T15:30:30.601549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2504,"log_dups_size":0,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3243,"num_write_kb":16596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'2748","reported_seq":2258,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.840360+0000","last_change":"2024-04-25T15:30:39.401031+0000","last_active":"2024-04-25T15:30:39.840360+0000","last_peered":"2024-04-25T15:30:39.840360+0000","last_clean":"2024-04-25T15:30:39.840360+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:30:39.840360+0000","last_undegraded":"2024-04-25T15:30:39.840360+0000","last_fullsized":"2024-04-25T15:30:39.840360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2748,"log_dups_size":0,"ondisk_log_size":2748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.298428+0000","scrub_duration":0,"objects_trimmed":78,"snaptrim_duration":2.6626469959999999,"stat_sum":{"num_bytes":8735,"num_objects":640,"num_object_clones":400,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":640,"num_whiteouts":239,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"40'133","reported_seq":193,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602613+0000","last_change":"2024-04-25T15:20:41.410949+0000","last_active":"2024-04-25T15:30:30.602613+0000","last_peered":"2024-04-25T15:30:30.602613+0000","last_clean":"2024-04-25T15:30:30.602613+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:30:30.602613+0000","last_undegraded":"2024-04-25T15:30:30.602613+0000","last_fullsized":"2024-04-25T15:30:30.602613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":213,"num_write_kb":8722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"41'2840","reported_seq":2302,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.261992+0000","last_change":"2024-04-25T15:30:39.262015+0000","last_active":"2024-04-25T15:30:39.261992+0000","last_peered":"2024-04-25T15:30:39.261992+0000","last_clean":"2024-04-25T15:30:39.261992+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:39.261992+0000","last_undegraded":"2024-04-25T15:30:39.261992+0000","last_fullsized":"2024-04-25T15:30:39.261992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.556786+0000","scrub_duration":0,"objects_trimmed":222,"snaptrim_duration":8.6675915420000003,"stat_sum":{"num_bytes":2592,"num_objects":432,"num_object_clones":216,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":216,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.8","version":"40'1036","reported_seq":1096,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600029+0000","last_change":"2024-04-25T15:20:41.405078+0000","last_active":"2024-04-25T15:30:30.600029+0000","last_peered":"2024-04-25T15:30:30.600029+0000","last_clean":"2024-04-25T15:30:30.600029+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:30:30.600029+0000","last_undegraded":"2024-04-25T15:30:30.600029+0000","last_fullsized":"2024-04-25T15:30:30.600029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1104,"num_write_kb":9199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"41'3352","reported_seq":2651,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.171838+0000","last_change":"2024-04-25T15:30:39.172045+0000","last_active":"2024-04-25T15:30:39.171838+0000","last_peered":"2024-04-25T15:30:39.171838+0000","last_clean":"2024-04-25T15:30:39.171838+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:39.171838+0000","last_undegraded":"2024-04-25T15:30:39.171838+0000","last_fullsized":"2024-04-25T15:30:39.171838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:59.054566+0000","scrub_duration":0,"objects_trimmed":673,"snaptrim_duration":8.5715076529999994,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.9","version":"40'1878","reported_seq":1937,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599834+0000","last_change":"2024-04-25T15:20:41.411766+0000","last_active":"2024-04-25T15:30:30.599834+0000","last_peered":"2024-04-25T15:30:30.599834+0000","last_clean":"2024-04-25T15:30:30.599834+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:30:30.599834+0000","last_undegraded":"2024-04-25T15:30:30.599834+0000","last_fullsized":"2024-04-25T15:30:30.599834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":1954,"num_write_kb":17506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"41'2829","reported_seq":2287,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.836669+0000","last_change":"2024-04-25T15:30:38.771956+0000","last_active":"2024-04-25T15:30:39.836669+0000","last_peered":"2024-04-25T15:30:39.836669+0000","last_clean":"2024-04-25T15:30:39.836669+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:30:39.836669+0000","last_undegraded":"2024-04-25T15:30:39.836669+0000","last_fullsized":"2024-04-25T15:30:39.836669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:25.485998+0000","scrub_duration":0,"objects_trimmed":176,"snaptrim_duration":2.6649829270000001,"stat_sum":{"num_bytes":3554,"num_objects":537,"num_object_clones":302,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":537,"num_whiteouts":234,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"40'3651","reported_seq":3710,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600436+0000","last_change":"2024-04-25T15:20:41.406926+0000","last_active":"2024-04-25T15:30:30.600436+0000","last_peered":"2024-04-25T15:30:30.600436+0000","last_clean":"2024-04-25T15:30:30.600436+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:30:30.600436+0000","last_undegraded":"2024-04-25T15:30:30.600436+0000","last_fullsized":"2024-04-25T15:30:30.600436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3651,"log_dups_size":0,"ondisk_log_size":3651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3718,"num_write_kb":26255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"41'2742","reported_seq":2232,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.853678+0000","last_change":"2024-04-25T15:30:36.468277+0000","last_active":"2024-04-25T15:30:36.853678+0000","last_peered":"2024-04-25T15:30:36.853678+0000","last_clean":"2024-04-25T15:30:36.853678+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:30:36.853678+0000","last_undegraded":"2024-04-25T15:30:36.853678+0000","last_fullsized":"2024-04-25T15:30:36.853678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:14.515815+0000","scrub_duration":0,"objects_trimmed":221,"snaptrim_duration":5.8786392230000004,"stat_sum":{"num_bytes":2436,"num_objects":408,"num_object_clones":204,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.b","version":"40'5227","reported_seq":5287,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599376+0000","last_change":"2024-04-25T15:20:41.408140+0000","last_active":"2024-04-25T15:30:30.599376+0000","last_peered":"2024-04-25T15:30:30.599376+0000","last_clean":"2024-04-25T15:30:30.599376+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:30:30.599376+0000","last_undegraded":"2024-04-25T15:30:30.599376+0000","last_fullsized":"2024-04-25T15:30:30.599376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":5301,"num_write_kb":30551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"41'3710","reported_seq":2942,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.060514+0000","last_change":"2024-04-25T15:30:38.060564+0000","last_active":"2024-04-25T15:30:38.060514+0000","last_peered":"2024-04-25T15:30:38.060514+0000","last_clean":"2024-04-25T15:30:38.060514+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:30:38.060514+0000","last_undegraded":"2024-04-25T15:30:38.060514+0000","last_fullsized":"2024-04-25T15:30:38.060514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.286828+0000","scrub_duration":0,"objects_trimmed":693,"snaptrim_duration":7.4581421309999998,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.1d","version":"41'2917","reported_seq":2396,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.809207+0000","last_change":"2024-04-25T15:30:35.988171+0000","last_active":"2024-04-25T15:30:36.809207+0000","last_peered":"2024-04-25T15:30:36.809207+0000","last_clean":"2024-04-25T15:30:36.809207+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:30:36.809207+0000","last_undegraded":"2024-04-25T15:30:36.809207+0000","last_fullsized":"2024-04-25T15:30:36.809207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:52.844251+0000","scrub_duration":0,"objects_trimmed":236,"snaptrim_duration":5.3939467600000004,"stat_sum":{"num_bytes":6688,"num_objects":440,"num_object_clones":218,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":218,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1c","version":"40'1127","reported_seq":1186,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.597966+0000","last_change":"2024-04-25T15:20:41.408459+0000","last_active":"2024-04-25T15:30:30.597966+0000","last_peered":"2024-04-25T15:30:30.597966+0000","last_clean":"2024-04-25T15:30:30.597966+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:30:30.597966+0000","last_undegraded":"2024-04-25T15:30:30.597966+0000","last_fullsized":"2024-04-25T15:30:30.597966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1211,"num_write_kb":4844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'3265","reported_seq":2622,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.550371+0000","last_change":"2024-04-25T15:30:39.550417+0000","last_active":"2024-04-25T15:30:39.550371+0000","last_peered":"2024-04-25T15:30:39.550371+0000","last_clean":"2024-04-25T15:30:39.550371+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:30:39.550371+0000","last_undegraded":"2024-04-25T15:30:39.550371+0000","last_fullsized":"2024-04-25T15:30:39.550371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3265,"log_dups_size":0,"ondisk_log_size":3265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:12.255072+0000","scrub_duration":0,"objects_trimmed":285,"snaptrim_duration":8.9557072630000008,"stat_sum":{"num_bytes":7324,"num_objects":540,"num_object_clones":269,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":269,"num_read":0,"num_read_kb":0,"num_write":1350,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1d","version":"40'8160","reported_seq":8219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598260+0000","last_change":"2024-04-25T15:20:41.408914+0000","last_active":"2024-04-25T15:30:30.598260+0000","last_peered":"2024-04-25T15:30:30.598260+0000","last_clean":"2024-04-25T15:30:30.598260+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:30:30.598260+0000","last_undegraded":"2024-04-25T15:30:30.598260+0000","last_fullsized":"2024-04-25T15:30:30.598260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":8160,"log_dups_size":0,"ondisk_log_size":8160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.598854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":8233,"num_write_kb":32021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"41'2841","reported_seq":2305,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.843142+0000","last_change":"2024-04-25T15:30:39.797864+0000","last_active":"2024-04-25T15:30:39.843142+0000","last_peered":"2024-04-25T15:30:39.843142+0000","last_clean":"2024-04-25T15:30:39.843142+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:30:39.843142+0000","last_undegraded":"2024-04-25T15:30:39.843142+0000","last_fullsized":"2024-04-25T15:30:39.843142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:18.229589+0000","scrub_duration":0,"objects_trimmed":251,"snaptrim_duration":1.5925796669999999,"stat_sum":{"num_bytes":2508,"num_objects":419,"num_object_clones":209,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1e","version":"40'6121","reported_seq":6181,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589353+0000","last_change":"2024-04-25T15:20:41.405976+0000","last_active":"2024-04-25T15:30:30.589353+0000","last_peered":"2024-04-25T15:30:30.589353+0000","last_clean":"2024-04-25T15:30:30.589353+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:30:30.589353+0000","last_undegraded":"2024-04-25T15:30:30.589353+0000","last_fullsized":"2024-04-25T15:30:30.589353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6121,"log_dups_size":0,"ondisk_log_size":6121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":6190,"num_write_kb":31064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"41'3023","reported_seq":2424,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.767688+0000","last_change":"2024-04-25T15:30:35.716433+0000","last_active":"2024-04-25T15:30:36.767688+0000","last_peered":"2024-04-25T15:30:36.767688+0000","last_clean":"2024-04-25T15:30:36.767688+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:30:36.767688+0000","last_undegraded":"2024-04-25T15:30:36.767688+0000","last_fullsized":"2024-04-25T15:30:36.767688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3023,"log_dups_size":0,"ondisk_log_size":3023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:17.235338+0000","scrub_duration":0,"objects_trimmed":234,"snaptrim_duration":5.1271952929999998,"stat_sum":{"num_bytes":6664,"num_objects":429,"num_object_clones":214,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":429,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1f","version":"40'2537","reported_seq":2597,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593005+0000","last_change":"2024-04-25T15:20:41.410750+0000","last_active":"2024-04-25T15:30:30.593005+0000","last_peered":"2024-04-25T15:30:30.593005+0000","last_clean":"2024-04-25T15:30:30.593005+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:30:30.593005+0000","last_undegraded":"2024-04-25T15:30:30.593005+0000","last_fullsized":"2024-04-25T15:30:30.593005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2537,"log_dups_size":0,"ondisk_log_size":2537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2610,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":250090,"num_objects":20120,"num_object_clones":10299,"num_object_copies":40240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20120,"num_whiteouts":9706,"num_read":44,"num_read_kb":30,"num_write":77732,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84484096,"data_stored":499700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203889,"ondisk_log_size":203889,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":265677919,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":835,"num_read_kb":3430,"num_write":91102,"num_write_kb":583108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":531415040,"data_stored":531355838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88184,"ondisk_log_size":88184,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":416236,"kb_used_data":82404,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":93955604,"statfs":{"total":96636764160,"available":96210538496,"internally_reserved":0,"allocated":84381696,"data_stored":66132745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":341834186},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396336,"kb_used_data":86120,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":93975504,"statfs":{"total":96636764160,"available":96230916096,"internally_reserved":0,"allocated":88186880,"data_stored":84126126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574973,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388852,"kb_used_data":96684,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93982988,"statfs":{"total":96636764160,"available":96238579712,"internally_reserved":0,"allocated":99004416,"data_stored":84177428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574973,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411104,"kb_used_data":73108,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":93960736,"statfs":{"total":96636764160,"available":96215793664,"internally_reserved":0,"allocated":74862592,"data_stored":63176542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346094022},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,3,3,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391964,"kb_used_data":85968,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93979876,"statfs":{"total":96636764160,"available":96235393024,"internally_reserved":0,"allocated":88031232,"data_stored":70719157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":313326023},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188228,"kb_used_data":40508,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94183612,"statfs":{"total":96636764160,"available":96444018688,"internally_reserved":0,"allocated":41480192,"data_stored":37093920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407400,"kb_used_data":91608,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93964440,"statfs":{"total":96636764160,"available":96219586560,"internally_reserved":0,"allocated":93806592,"data_stored":86453251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":323353029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326652,"kb_used_data":56748,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94045188,"statfs":{"total":96636764160,"available":96302272512,"internally_reserved":0,"allocated":58109952,"data_stored":42806283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86220800,"data_stored":86212586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36859904,"data_stored":36857687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70422528,"data_stored":70412791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62926848,"data_stored":62914839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83890176,"data_stored":83886170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83894272,"data_stored":83886752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65245184,"data_stored":65241335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14450688,"data_stored":66754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5922816,"data_stored":33618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3985408,"data_stored":32095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15921152,"data_stored":99292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10637312,"data_stored":55684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14123008,"data_stored":86097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3084288,"data_stored":33556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16359424,"data_stored":92604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:30:43.183 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T15:30:43.183 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:30:43.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.376+0000 7f71d7c8c640 1 Processor -- start 2024-04-25T15:30:43.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.376+0000 7f71d7c8c640 1 -- start start 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.377+0000 7f71d7c8c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f71d00bb390 0x7f71d0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.377+0000 7f71d7c8c640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d00718d0 con 0x7f71d01571e0 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.377+0000 7f71d7c8c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d0073a10 con 0x7f71d0072e30 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.377+0000 7f71d7c8c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f71d00bb7a0 con 0x7f71d00bb390 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.377+0000 7f71d6229640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f71d01571e0 0x7f71d0160dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43628/0 (socket says 172.21.15.33:43628) 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.377+0000 7f71d6229640 1 -- 172.21.15.33:0/1822682180 learned_addr learned my addr 172.21.15.33:0/1822682180 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.377+0000 7f71d5a28640 1 --2- 172.21.15.33:0/1822682180 >> v2:172.21.15.155:3300/0 conn(0x7f71d00bb390 0x7f71d0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.378+0000 7f71d4a26640 1 -- 172.21.15.33:0/1822682180 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401892488 0 0) 0x7f71c8001490 con 0x7f71d01571e0 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.409+0000 7f71d4a26640 1 -- 172.21.15.33:0/1822682180 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71bc003500 con 0x7f71d01571e0 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.409+0000 7f71d4a26640 1 -- 172.21.15.33:0/1822682180 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643520428 0 0) 0x7f71d0073a10 con 0x7f71d0072e30 2024-04-25T15:30:43.411 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.409+0000 7f71d4a26640 1 -- 172.21.15.33:0/1822682180 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71c8001490 con 0x7f71d0072e30 2024-04-25T15:30:43.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.410+0000 7f71d5a28640 1 -- 172.21.15.33:0/1822682180 >> v1:172.21.15.155:6789/0 conn(0x7f71d0072e30 legacy=0x7f71d0156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.410+0000 7f71d4a26640 1 -- 172.21.15.33:0/1822682180 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3748097061 0 0) 0x7f71c8001490 con 0x7f71d0072e30 2024-04-25T15:30:43.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.410+0000 7f71d5a28640 1 -- 172.21.15.33:0/1822682180 >> v1:172.21.15.33:6789/0 conn(0x7f71d01571e0 legacy=0x7f71d0160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.410+0000 7f71d5a28640 1 -- 172.21.15.33:0/1822682180 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d0071b50 con 0x7f71d00bb390 2024-04-25T15:30:43.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.411+0000 7f71d5a28640 1 --2- 172.21.15.33:0/1822682180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d00bb390 0x7f71d0159aa0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009720 tx=0x7f71cc02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fbc30edf9725e30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:43.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.412+0000 7f71d4a26640 1 -- 172.21.15.33:0/1822682180 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc037070 con 0x7f71d00bb390 2024-04-25T15:30:43.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.412+0000 7f71d4a26640 1 -- 172.21.15.33:0/1822682180 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71cc02aaf0 con 0x7f71d00bb390 2024-04-25T15:30:43.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.412+0000 7f71d4a26640 1 -- 172.21.15.33:0/1822682180 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8001bc0 con 0x7f71d00bb390 2024-04-25T15:30:43.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.413+0000 7f71d7c8c640 1 -- 172.21.15.33:0/1822682180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d00bb390 msgr2=0x7f71d0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.413+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/1822682180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d00bb390 0x7f71d0159aa0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009720 tx=0x7f71cc02a060 comp rx=0 tx=0).stop 2024-04-25T15:30:43.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.413+0000 7f71d7c8c640 1 -- 172.21.15.33:0/1822682180 shutdown_connections 2024-04-25T15:30:43.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.413+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/1822682180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d00bb390 0x7f71d0159aa0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.413+0000 7f71d7c8c640 1 -- 172.21.15.33:0/1822682180 >> 172.21.15.33:0/1822682180 conn(0x7f71d006cbf0 msgr2=0x7f71d00ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:43.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.414+0000 7f71d7c8c640 1 -- 172.21.15.33:0/1822682180 shutdown_connections 2024-04-25T15:30:43.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.414+0000 7f71d7c8c640 1 -- 172.21.15.33:0/1822682180 wait complete. 2024-04-25T15:30:43.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.416+0000 7f71d7c8c640 1 Processor -- start 2024-04-25T15:30:43.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.416+0000 7f71d7c8c640 1 -- start start 2024-04-25T15:30:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.418+0000 7f71d7c8c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71d0072e30 0x7f71d01ef720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:43.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.418+0000 7f71d5a28640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71d0072e30 0x7f71d01ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:43.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.418+0000 7f71d5a28640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71d0072e30 0x7f71d01ef720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45424/0 (socket says 172.21.15.33:45424) 2024-04-25T15:30:43.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.419+0000 7f71d5a28640 1 -- 172.21.15.33:0/643323908 learned_addr learned my addr 172.21.15.33:0/643323908 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:43.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.419+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71d00bb390 0x7f71d00b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:43.420 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.419+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d01571e0 0x7f71d008b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:43.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.419+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f71d00b7160 con 0x7f71d0072e30 2024-04-25T15:30:43.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.419+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71d0073690 con 0x7f71d01571e0 2024-04-25T15:30:43.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.419+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71d00b72e0 con 0x7f71d00bb390 2024-04-25T15:30:43.421 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.419+0000 7f71d6229640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d01571e0 0x7f71d008b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71d5a28640 1 -- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71d00bb390 msgr2=0x7f71d00b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71d5a28640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71d00bb390 0x7f71d00b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71d5a28640 1 -- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d01571e0 msgr2=0x7f71d008b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71d5a28640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d01571e0 0x7f71d008b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71d5a28640 1 -- 172.21.15.33:0/643323908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d01525f0 con 0x7f71d0072e30 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71d5a28640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71d0072e30 0x7f71d01ef720 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009840 tx=0x7f71cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71c67fc640 1 -- 172.21.15.33:0/643323908 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc042020 con 0x7f71d0072e30 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d0151b70 con 0x7f71d0072e30 2024-04-25T15:30:43.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d00aa4d0 con 0x7f71d0072e30 2024-04-25T15:30:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.420+0000 7f71c67fc640 1 -- 172.21.15.33:0/643323908 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71cc02aaf0 con 0x7f71d0072e30 2024-04-25T15:30:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.421+0000 7f71c67fc640 1 -- 172.21.15.33:0/643323908 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc037040 con 0x7f71d0072e30 2024-04-25T15:30:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.422+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b8005290 con 0x7f71d0072e30 2024-04-25T15:30:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.424+0000 7f71c67fc640 1 -- 172.21.15.33:0/643323908 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f71cc045020 con 0x7f71d0072e30 2024-04-25T15:30:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.424+0000 7f71c67fc640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71b40744b0 0x7f71b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.424+0000 7f71c67fc640 1 -- 172.21.15.33:0/643323908 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f71cc0b59c0 con 0x7f71d0072e30 2024-04-25T15:30:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.426+0000 7f71d5227640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71b40744b0 0x7f71b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.427+0000 7f71d5227640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71b40744b0 0x7f71b40769c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f71c0001eb0 tx=0x7f71c00019a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.435+0000 7f71c67fc640 1 -- 172.21.15.33:0/643323908 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71cc080070 con 0x7f71d0072e30 2024-04-25T15:30:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.763+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71b8000bc0 con 0x7f71b40744b0 2024-04-25T15:30:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.774+0000 7f71c67fc640 1 -- 172.21.15.33:0/643323908 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258476 (secure 0 0 0) 0x7f71b8000bc0 con 0x7f71b40744b0 2024-04-25T15:30:43.778 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:30:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:30:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71b40744b0 msgr2=0x7f71b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71b40744b0 0x7f71b40769c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f71c0001eb0 tx=0x7f71c00019a0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71d0072e30 msgr2=0x7f71d01ef720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:43.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71d0072e30 0x7f71d01ef720 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009840 tx=0x7f71cc0046c0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 shutdown_connections 2024-04-25T15:30:43.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f71b40744b0 0x7f71b40769c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71d01571e0 0x7f71d008b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71d00bb390 0x7f71d00b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 --2- 172.21.15.33:0/643323908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71d0072e30 0x7f71d01ef720 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:43.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 >> 172.21.15.33:0/643323908 conn(0x7f71d006cbf0 msgr2=0x7f71d0155ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:43.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 shutdown_connections 2024-04-25T15:30:43.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:43.779+0000 7f71d7c8c640 1 -- 172.21.15.33:0/643323908 wait complete. 2024-04-25T15:30:43.798 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-04-25T15:30:41.848948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":266518377,"num_objects":20736,"num_object_clones":10299,"num_object_copies":41472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20736,"num_whiteouts":9706,"num_read":945,"num_read_kb":3515,"num_write":168935,"num_write_kb":625333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292145,"ondisk_log_size":292145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2926772,"kb_used_data":613148,"kb_used_omap":12,"kb_used_meta":2313523,"kb_avail":752047948,"statfs":{"total":773094113280,"available":770097098752,"internally_reserved":0,"allocated":627863552,"data_stored":534685452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":2369048114},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,4,7,9,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-147898,"num_objects":-24870,"num_object_clones":-19457,"num_object_copies":-49740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24870,"num_whiteouts":-5413,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.256374"},"pg_stats":[{"pgid":"3.3f","version":"41'2829","reported_seq":2323,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.717491+0000","last_change":"2024-04-25T15:30:37.717537+0000","last_active":"2024-04-25T15:30:37.717491+0000","last_peered":"2024-04-25T15:30:37.717491+0000","last_clean":"2024-04-25T15:30:37.717491+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:30:37.717491+0000","last_undegraded":"2024-04-25T15:30:37.717491+0000","last_fullsized":"2024-04-25T15:30:37.717491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:24.611556+0000","scrub_duration":0,"objects_trimmed":224,"snaptrim_duration":7.1170097969999997,"stat_sum":{"num_bytes":2448,"num_objects":410,"num_object_clones":204,"num_object_copies":820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3e","version":"41'2630","reported_seq":2112,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.161216+0000","last_change":"2024-04-25T15:30:37.161265+0000","last_active":"2024-04-25T15:30:37.161216+0000","last_peered":"2024-04-25T15:30:37.161216+0000","last_clean":"2024-04-25T15:30:37.161216+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:30:37.161216+0000","last_undegraded":"2024-04-25T15:30:37.161216+0000","last_fullsized":"2024-04-25T15:30:37.161216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2630,"log_dups_size":0,"ondisk_log_size":2630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:52.269365+0000","scrub_duration":0,"objects_trimmed":224,"snaptrim_duration":6.5598153510000001,"stat_sum":{"num_bytes":2472,"num_objects":412,"num_object_clones":206,"num_object_copies":824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":412,"num_whiteouts":206,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3d","version":"41'3137","reported_seq":2548,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.882826+0000","last_change":"2024-04-25T15:30:37.882872+0000","last_active":"2024-04-25T15:30:37.882826+0000","last_peered":"2024-04-25T15:30:37.882826+0000","last_clean":"2024-04-25T15:30:37.882826+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:30:37.882826+0000","last_undegraded":"2024-04-25T15:30:37.882826+0000","last_fullsized":"2024-04-25T15:30:37.882826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:14.294299+0000","scrub_duration":0,"objects_trimmed":237,"snaptrim_duration":7.2888411399999997,"stat_sum":{"num_bytes":6820,"num_objects":458,"num_object_clones":227,"num_object_copies":916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":458,"num_whiteouts":227,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3c","version":"41'3136","reported_seq":2496,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.803853+0000","last_change":"2024-04-25T15:30:39.688349+0000","last_active":"2024-04-25T15:30:39.803853+0000","last_peered":"2024-04-25T15:30:39.803853+0000","last_clean":"2024-04-25T15:30:39.803853+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:30:39.803853+0000","last_undegraded":"2024-04-25T15:30:39.803853+0000","last_fullsized":"2024-04-25T15:30:39.803853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3136,"log_dups_size":0,"ondisk_log_size":3136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.556786+0000","scrub_duration":0,"objects_trimmed":312,"snaptrim_duration":4.1254658519999996,"stat_sum":{"num_bytes":10939,"num_objects":462,"num_object_clones":228,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":462,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3b","version":"41'3146","reported_seq":2504,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.714065+0000","last_change":"2024-04-25T15:30:36.290986+0000","last_active":"2024-04-25T15:30:36.714065+0000","last_peered":"2024-04-25T15:30:36.714065+0000","last_clean":"2024-04-25T15:30:36.714065+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:30:36.714065+0000","last_undegraded":"2024-04-25T15:30:36.714065+0000","last_fullsized":"2024-04-25T15:30:36.714065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3146,"log_dups_size":0,"ondisk_log_size":3146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:42.248138+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":5.6918965269999999,"stat_sum":{"num_bytes":6976,"num_objects":481,"num_object_clones":240,"num_object_copies":962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":481,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.3a","version":"41'3483","reported_seq":2770,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.701126+0000","last_change":"2024-04-25T15:30:38.703165+0000","last_active":"2024-04-25T15:30:38.701126+0000","last_peered":"2024-04-25T15:30:38.701126+0000","last_clean":"2024-04-25T15:30:38.701126+0000","last_became_active":"2024-04-25T15:21:23.754462+0000","last_became_peered":"2024-04-25T15:21:23.754462+0000","last_unstale":"2024-04-25T15:30:38.701126+0000","last_undegraded":"2024-04-25T15:30:38.701126+0000","last_fullsized":"2024-04-25T15:30:38.701126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3483,"log_dups_size":0,"ondisk_log_size":3483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:36.167106+0000","scrub_duration":0,"objects_trimmed":689,"snaptrim_duration":8.0917395699999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.39","version":"41'2960","reported_seq":2399,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.826398+0000","last_change":"2024-04-25T15:30:39.508551+0000","last_active":"2024-04-25T15:30:39.826398+0000","last_peered":"2024-04-25T15:30:39.826398+0000","last_clean":"2024-04-25T15:30:39.826398+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:30:39.826398+0000","last_undegraded":"2024-04-25T15:30:39.826398+0000","last_fullsized":"2024-04-25T15:30:39.826398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2960,"log_dups_size":0,"ondisk_log_size":2960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:13.096251+0000","scrub_duration":0,"objects_trimmed":355,"snaptrim_duration":2.4448173,"stat_sum":{"num_bytes":6152,"num_objects":330,"num_object_clones":164,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":330,"num_whiteouts":163,"num_read":1,"num_read_kb":0,"num_write":1188,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.38","version":"41'2720","reported_seq":2196,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.856018+0000","last_change":"2024-04-25T15:30:32.858743+0000","last_active":"2024-04-25T15:30:36.856018+0000","last_peered":"2024-04-25T15:30:36.856018+0000","last_clean":"2024-04-25T15:30:36.856018+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:30:36.856018+0000","last_undegraded":"2024-04-25T15:30:36.856018+0000","last_fullsized":"2024-04-25T15:30:36.856018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2720,"log_dups_size":0,"ondisk_log_size":2720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:39.840877+0000","scrub_duration":0,"objects_trimmed":237,"snaptrim_duration":2.2674431460000002,"stat_sum":{"num_bytes":6724,"num_objects":439,"num_object_clones":219,"num_object_copies":878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":219,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.37","version":"41'3084","reported_seq":2514,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.877805+0000","last_change":"2024-04-25T15:30:38.877851+0000","last_active":"2024-04-25T15:30:38.877805+0000","last_peered":"2024-04-25T15:30:38.877805+0000","last_clean":"2024-04-25T15:30:38.877805+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:30:38.877805+0000","last_undegraded":"2024-04-25T15:30:38.877805+0000","last_fullsized":"2024-04-25T15:30:38.877805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:34.457672+0000","scrub_duration":0,"objects_trimmed":251,"snaptrim_duration":8.2771185579999997,"stat_sum":{"num_bytes":2748,"num_objects":460,"num_object_clones":229,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":460,"num_whiteouts":229,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.36","version":"41'3421","reported_seq":2816,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.170307+0000","last_change":"2024-04-25T15:30:37.170350+0000","last_active":"2024-04-25T15:30:37.170307+0000","last_peered":"2024-04-25T15:30:37.170307+0000","last_clean":"2024-04-25T15:30:37.170307+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:30:37.170307+0000","last_undegraded":"2024-04-25T15:30:37.170307+0000","last_fullsized":"2024-04-25T15:30:37.170307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:26.387482+0000","scrub_duration":0,"objects_trimmed":653,"snaptrim_duration":6.5677128429999998,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.35","version":"41'3365","reported_seq":2707,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.723622+0000","last_change":"2024-04-25T15:30:36.328180+0000","last_active":"2024-04-25T15:30:36.723622+0000","last_peered":"2024-04-25T15:30:36.723622+0000","last_clean":"2024-04-25T15:30:36.723622+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:30:36.723622+0000","last_undegraded":"2024-04-25T15:30:36.723622+0000","last_fullsized":"2024-04-25T15:30:36.723622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:20.257648+0000","scrub_duration":0,"objects_trimmed":691,"snaptrim_duration":5.7256742149999997,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.34","version":"41'3667","reported_seq":2916,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.675536+0000","last_change":"2024-04-25T15:30:38.675909+0000","last_active":"2024-04-25T15:30:38.675536+0000","last_peered":"2024-04-25T15:30:38.675536+0000","last_clean":"2024-04-25T15:30:38.675536+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:30:38.675536+0000","last_undegraded":"2024-04-25T15:30:38.675536+0000","last_fullsized":"2024-04-25T15:30:38.675536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:10.365408+0000","scrub_duration":0,"objects_trimmed":759,"snaptrim_duration":8.0780853560000008,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.33","version":"41'2832","reported_seq":2321,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.529493+0000","last_change":"2024-04-25T15:30:37.529542+0000","last_active":"2024-04-25T15:30:37.529493+0000","last_peered":"2024-04-25T15:30:37.529493+0000","last_clean":"2024-04-25T15:30:37.529493+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:30:37.529493+0000","last_undegraded":"2024-04-25T15:30:37.529493+0000","last_fullsized":"2024-04-25T15:30:37.529493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2832,"log_dups_size":0,"ondisk_log_size":2832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:18.828740+0000","scrub_duration":0,"objects_trimmed":225,"snaptrim_duration":6.9396563239999995,"stat_sum":{"num_bytes":6660,"num_objects":425,"num_object_clones":211,"num_object_copies":850,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":425,"num_whiteouts":211,"num_read":1,"num_read_kb":0,"num_write":1152,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.32","version":"41'2851","reported_seq":2296,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.820687+0000","last_change":"2024-04-25T15:30:35.695421+0000","last_active":"2024-04-25T15:30:36.820687+0000","last_peered":"2024-04-25T15:30:36.820687+0000","last_clean":"2024-04-25T15:30:36.820687+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:30:36.820687+0000","last_undegraded":"2024-04-25T15:30:36.820687+0000","last_fullsized":"2024-04-25T15:30:36.820687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2851,"log_dups_size":0,"ondisk_log_size":2851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:32.390382+0000","scrub_duration":0,"objects_trimmed":254,"snaptrim_duration":5.1020456789999997,"stat_sum":{"num_bytes":2772,"num_objects":464,"num_object_clones":232,"num_object_copies":928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":464,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.31","version":"41'3614","reported_seq":2868,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.818073+0000","last_change":"2024-04-25T15:30:37.608682+0000","last_active":"2024-04-25T15:30:39.818073+0000","last_peered":"2024-04-25T15:30:39.818073+0000","last_clean":"2024-04-25T15:30:39.818073+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:30:39.818073+0000","last_undegraded":"2024-04-25T15:30:39.818073+0000","last_fullsized":"2024-04-25T15:30:39.818073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.286828+0000","scrub_duration":0,"objects_trimmed":718,"snaptrim_duration":3.3798137829999999,"stat_sum":{"num_bytes":24,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.30","version":"41'3345","reported_seq":2704,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.805396+0000","last_change":"2024-04-25T15:30:39.550459+0000","last_active":"2024-04-25T15:30:39.805396+0000","last_peered":"2024-04-25T15:30:39.805396+0000","last_clean":"2024-04-25T15:30:39.805396+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:30:39.805396+0000","last_undegraded":"2024-04-25T15:30:39.805396+0000","last_fullsized":"2024-04-25T15:30:39.805396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3345,"log_dups_size":0,"ondisk_log_size":3345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:14.294299+0000","scrub_duration":0,"objects_trimmed":309,"snaptrim_duration":3.23396032,"stat_sum":{"num_bytes":2340,"num_objects":395,"num_object_clones":196,"num_object_copies":790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":196,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2f","version":"41'3039","reported_seq":2454,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.765443+0000","last_change":"2024-04-25T15:30:35.194447+0000","last_active":"2024-04-25T15:30:36.765443+0000","last_peered":"2024-04-25T15:30:36.765443+0000","last_clean":"2024-04-25T15:30:36.765443+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:30:36.765443+0000","last_undegraded":"2024-04-25T15:30:36.765443+0000","last_fullsized":"2024-04-25T15:30:36.765443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3039,"log_dups_size":0,"ondisk_log_size":3039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:25.180751+0000","scrub_duration":0,"objects_trimmed":267,"snaptrim_duration":4.6003804729999995,"stat_sum":{"num_bytes":7115,"num_objects":503,"num_object_clones":250,"num_object_copies":1006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":503,"num_whiteouts":249,"num_read":29,"num_read_kb":23,"num_write":1332,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2e","version":"41'3381","reported_seq":2767,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.293789+0000","last_change":"2024-04-25T15:30:37.294444+0000","last_active":"2024-04-25T15:30:37.293789+0000","last_peered":"2024-04-25T15:30:37.293789+0000","last_clean":"2024-04-25T15:30:37.293789+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:30:37.293789+0000","last_undegraded":"2024-04-25T15:30:37.293789+0000","last_fullsized":"2024-04-25T15:30:37.293789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3381,"log_dups_size":0,"ondisk_log_size":3381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:39.283655+0000","scrub_duration":0,"objects_trimmed":607,"snaptrim_duration":6.6868273169999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1074,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.2d","version":"41'2935","reported_seq":2377,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.769129+0000","last_change":"2024-04-25T15:30:34.823111+0000","last_active":"2024-04-25T15:30:36.769129+0000","last_peered":"2024-04-25T15:30:36.769129+0000","last_clean":"2024-04-25T15:30:36.769129+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:30:36.769129+0000","last_undegraded":"2024-04-25T15:30:36.769129+0000","last_fullsized":"2024-04-25T15:30:36.769129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":0,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.008764+0000","scrub_duration":0,"objects_trimmed":241,"snaptrim_duration":4.2245572769999997,"stat_sum":{"num_bytes":10796,"num_objects":437,"num_object_clones":217,"num_object_copies":874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":437,"num_whiteouts":217,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2c","version":"41'3637","reported_seq":2956,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.782864+0000","last_change":"2024-04-25T15:30:38.584170+0000","last_active":"2024-04-25T15:30:39.782864+0000","last_peered":"2024-04-25T15:30:39.782864+0000","last_clean":"2024-04-25T15:30:39.782864+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:30:39.782864+0000","last_undegraded":"2024-04-25T15:30:39.782864+0000","last_fullsized":"2024-04-25T15:30:39.782864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3637,"log_dups_size":0,"ondisk_log_size":3637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.188818+0000","scrub_duration":0,"objects_trimmed":675,"snaptrim_duration":4.527686181,"stat_sum":{"num_bytes":4381,"num_objects":48,"num_object_clones":23,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":23,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2b","version":"41'2589","reported_seq":2125,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.840738+0000","last_change":"2024-04-25T15:30:39.261980+0000","last_active":"2024-04-25T15:30:39.840738+0000","last_peered":"2024-04-25T15:30:39.840738+0000","last_clean":"2024-04-25T15:30:39.840738+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:30:39.840738+0000","last_undegraded":"2024-04-25T15:30:39.840738+0000","last_fullsized":"2024-04-25T15:30:39.840738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2589,"log_dups_size":0,"ondisk_log_size":2589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:25.180751+0000","scrub_duration":0,"objects_trimmed":93,"snaptrim_duration":2.5085498839999998,"stat_sum":{"num_bytes":12295,"num_objects":576,"num_object_clones":353,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":576,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"41'3477","reported_seq":2811,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.369522+0000","last_change":"2024-04-25T15:30:38.369568+0000","last_active":"2024-04-25T15:30:38.369522+0000","last_peered":"2024-04-25T15:30:38.369522+0000","last_clean":"2024-04-25T15:30:38.369522+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:30:38.369522+0000","last_undegraded":"2024-04-25T15:30:38.369522+0000","last_fullsized":"2024-04-25T15:30:38.369522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3477,"log_dups_size":0,"ondisk_log_size":3477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:38.889747+0000","scrub_duration":0,"objects_trimmed":279,"snaptrim_duration":7.7756122369999998,"stat_sum":{"num_bytes":2988,"num_objects":499,"num_object_clones":249,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":249,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.29","version":"41'2839","reported_seq":2307,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.771891+0000","last_change":"2024-04-25T15:30:38.771953+0000","last_active":"2024-04-25T15:30:38.771891+0000","last_peered":"2024-04-25T15:30:38.771891+0000","last_clean":"2024-04-25T15:30:38.771891+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:30:38.771891+0000","last_undegraded":"2024-04-25T15:30:38.771891+0000","last_fullsized":"2024-04-25T15:30:38.771891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:19.962755+0000","scrub_duration":0,"objects_trimmed":234,"snaptrim_duration":8.1826379809999992,"stat_sum":{"num_bytes":2688,"num_objects":448,"num_object_clones":224,"num_object_copies":896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":448,"num_whiteouts":224,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.28","version":"41'3870","reported_seq":3072,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.688276+0000","last_change":"2024-04-25T15:30:39.688338+0000","last_active":"2024-04-25T15:30:39.688276+0000","last_peered":"2024-04-25T15:30:39.688276+0000","last_clean":"2024-04-25T15:30:39.688276+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:30:39.688276+0000","last_undegraded":"2024-04-25T15:30:39.688276+0000","last_fullsized":"2024-04-25T15:30:39.688276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:50.436650+0000","scrub_duration":0,"objects_trimmed":736,"snaptrim_duration":9.0947790669999993,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.27","version":"41'2706","reported_seq":2190,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.756049+0000","last_change":"2024-04-25T15:30:34.264406+0000","last_active":"2024-04-25T15:30:36.756049+0000","last_peered":"2024-04-25T15:30:36.756049+0000","last_clean":"2024-04-25T15:30:36.756049+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:30:36.756049+0000","last_undegraded":"2024-04-25T15:30:36.756049+0000","last_fullsized":"2024-04-25T15:30:36.756049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2706,"log_dups_size":0,"ondisk_log_size":2706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:12.255072+0000","scrub_duration":0,"objects_trimmed":221,"snaptrim_duration":3.675183461,"stat_sum":{"num_bytes":2508,"num_objects":420,"num_object_clones":210,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":210,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.26","version":"41'3511","reported_seq":2842,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.082124+0000","last_change":"2024-04-25T15:30:39.082167+0000","last_active":"2024-04-25T15:30:39.082124+0000","last_peered":"2024-04-25T15:30:39.082124+0000","last_clean":"2024-04-25T15:30:39.082124+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:30:39.082124+0000","last_undegraded":"2024-04-25T15:30:39.082124+0000","last_fullsized":"2024-04-25T15:30:39.082124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:34.715196+0000","scrub_duration":0,"objects_trimmed":665,"snaptrim_duration":8.4792293389999998,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.25","version":"41'3084","reported_seq":2454,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.813596+0000","last_change":"2024-04-25T15:30:35.728684+0000","last_active":"2024-04-25T15:30:36.813596+0000","last_peered":"2024-04-25T15:30:36.813596+0000","last_clean":"2024-04-25T15:30:36.813596+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:30:36.813596+0000","last_undegraded":"2024-04-25T15:30:36.813596+0000","last_fullsized":"2024-04-25T15:30:36.813596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:34.715196+0000","scrub_duration":0,"objects_trimmed":236,"snaptrim_duration":5.1279696599999998,"stat_sum":{"num_bytes":6736,"num_objects":442,"num_object_clones":220,"num_object_copies":884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":442,"num_whiteouts":220,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.24","version":"41'2870","reported_seq":2298,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.400954+0000","last_change":"2024-04-25T15:30:39.401000+0000","last_active":"2024-04-25T15:30:39.400954+0000","last_peered":"2024-04-25T15:30:39.400954+0000","last_clean":"2024-04-25T15:30:39.400954+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:30:39.400954+0000","last_undegraded":"2024-04-25T15:30:39.400954+0000","last_fullsized":"2024-04-25T15:30:39.400954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2870,"log_dups_size":0,"ondisk_log_size":2870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:42.101503+0000","scrub_duration":0,"objects_trimmed":228,"snaptrim_duration":8.8116670890000002,"stat_sum":{"num_bytes":2568,"num_objects":429,"num_object_clones":214,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":429,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.23","version":"41'2974","reported_seq":2391,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.089089+0000","last_change":"2024-04-25T15:30:38.089128+0000","last_active":"2024-04-25T15:30:38.089089+0000","last_peered":"2024-04-25T15:30:38.089089+0000","last_clean":"2024-04-25T15:30:38.089089+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:30:38.089089+0000","last_undegraded":"2024-04-25T15:30:38.089089+0000","last_fullsized":"2024-04-25T15:30:38.089089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2974,"log_dups_size":0,"ondisk_log_size":2974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:08.750880+0000","scrub_duration":0,"objects_trimmed":255,"snaptrim_duration":7.4951841339999996,"stat_sum":{"num_bytes":6940,"num_objects":475,"num_object_clones":237,"num_object_copies":950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":475,"num_whiteouts":237,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.22","version":"41'3138","reported_seq":2509,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.299277+0000","last_change":"2024-04-25T15:30:37.300211+0000","last_active":"2024-04-25T15:30:37.299277+0000","last_peered":"2024-04-25T15:30:37.299277+0000","last_clean":"2024-04-25T15:30:37.299277+0000","last_became_active":"2024-04-25T15:21:23.859850+0000","last_became_peered":"2024-04-25T15:21:23.859850+0000","last_unstale":"2024-04-25T15:30:37.299277+0000","last_undegraded":"2024-04-25T15:30:37.299277+0000","last_fullsized":"2024-04-25T15:30:37.299277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3138,"log_dups_size":0,"ondisk_log_size":3138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:29:49.950843+0000","scrub_duration":0,"objects_trimmed":606,"snaptrim_duration":6.6890380110000001,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.21","version":"41'4292","reported_seq":3407,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.296102+0000","last_change":"2024-04-25T15:30:37.296764+0000","last_active":"2024-04-25T15:30:37.296102+0000","last_peered":"2024-04-25T15:30:37.296102+0000","last_clean":"2024-04-25T15:30:37.296102+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:30:37.296102+0000","last_undegraded":"2024-04-25T15:30:37.296102+0000","last_fullsized":"2024-04-25T15:30:37.296102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":4292,"log_dups_size":0,"ondisk_log_size":4292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:20.083988+0000","scrub_duration":0,"objects_trimmed":828,"snaptrim_duration":6.6887649839999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1392,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.20","version":"41'3875","reported_seq":3100,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.584094+0000","last_change":"2024-04-25T15:30:38.584137+0000","last_active":"2024-04-25T15:30:38.584094+0000","last_peered":"2024-04-25T15:30:38.584094+0000","last_clean":"2024-04-25T15:30:38.584094+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:30:38.584094+0000","last_undegraded":"2024-04-25T15:30:38.584094+0000","last_fullsized":"2024-04-25T15:30:38.584094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3875,"log_dups_size":0,"ondisk_log_size":3875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:27.011814+0000","scrub_duration":0,"objects_trimmed":743,"snaptrim_duration":7.9821429300000002,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.1a","version":"41'3757","reported_seq":2998,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676006+0000","last_change":"2024-04-25T15:30:38.676214+0000","last_active":"2024-04-25T15:30:38.676006+0000","last_peered":"2024-04-25T15:30:38.676006+0000","last_clean":"2024-04-25T15:30:38.676006+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:30:38.676006+0000","last_undegraded":"2024-04-25T15:30:38.676006+0000","last_fullsized":"2024-04-25T15:30:38.676006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:32.184227+0000","scrub_duration":0,"objects_trimmed":718,"snaptrim_duration":8.0786759789999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.1b","version":"40'3208","reported_seq":3267,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589972+0000","last_change":"2024-04-25T15:20:41.411834+0000","last_active":"2024-04-25T15:30:30.589972+0000","last_peered":"2024-04-25T15:30:30.589972+0000","last_clean":"2024-04-25T15:30:30.589972+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:30:30.589972+0000","last_undegraded":"2024-04-25T15:30:30.589972+0000","last_fullsized":"2024-04-25T15:30:30.589972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":3284,"num_write_kb":9502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"41'2975","reported_seq":2406,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.797633+0000","last_change":"2024-04-25T15:30:39.797773+0000","last_active":"2024-04-25T15:30:39.797633+0000","last_peered":"2024-04-25T15:30:39.797633+0000","last_clean":"2024-04-25T15:30:39.797633+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:30:39.797633+0000","last_undegraded":"2024-04-25T15:30:39.797633+0000","last_fullsized":"2024-04-25T15:30:39.797633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2975,"log_dups_size":0,"ondisk_log_size":2975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:50.436650+0000","scrub_duration":0,"objects_trimmed":257,"snaptrim_duration":9.2035530340000005,"stat_sum":{"num_bytes":2940,"num_objects":491,"num_object_clones":245,"num_object_copies":982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":491,"num_whiteouts":245,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1a","version":"40'6006","reported_seq":6065,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602379+0000","last_change":"2024-04-25T15:20:41.401581+0000","last_active":"2024-04-25T15:30:30.602379+0000","last_peered":"2024-04-25T15:30:30.602379+0000","last_clean":"2024-04-25T15:30:30.602379+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:30:30.602379+0000","last_undegraded":"2024-04-25T15:30:30.602379+0000","last_fullsized":"2024-04-25T15:30:30.602379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6006,"log_dups_size":0,"ondisk_log_size":6006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":6066,"num_write_kb":31066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"40'881","reported_seq":941,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589144+0000","last_change":"2024-04-25T15:20:41.404692+0000","last_active":"2024-04-25T15:30:30.589144+0000","last_peered":"2024-04-25T15:30:30.589144+0000","last_clean":"2024-04-25T15:30:30.589144+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:30:30.589144+0000","last_undegraded":"2024-04-25T15:30:30.589144+0000","last_fullsized":"2024-04-25T15:30:30.589144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":944,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"41'3300","reported_seq":2631,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.856467+0000","last_change":"2024-04-25T15:30:34.747823+0000","last_active":"2024-04-25T15:30:36.856467+0000","last_peered":"2024-04-25T15:30:36.856467+0000","last_clean":"2024-04-25T15:30:36.856467+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:30:36.856467+0000","last_undegraded":"2024-04-25T15:30:36.856467+0000","last_fullsized":"2024-04-25T15:30:36.856467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3300,"log_dups_size":0,"ondisk_log_size":3300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:35.107011+0000","scrub_duration":0,"objects_trimmed":282,"snaptrim_duration":4.1586895349999997,"stat_sum":{"num_bytes":3227,"num_objects":540,"num_object_clones":269,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":269,"num_read":0,"num_read_kb":0,"num_write":1372,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.18","version":"40'3115","reported_seq":3175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593773+0000","last_change":"2024-04-25T15:20:41.406208+0000","last_active":"2024-04-25T15:30:30.593773+0000","last_peered":"2024-04-25T15:30:30.593773+0000","last_clean":"2024-04-25T15:30:30.593773+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:30:30.593773+0000","last_undegraded":"2024-04-25T15:30:30.593773+0000","last_fullsized":"2024-04-25T15:30:30.593773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3115,"log_dups_size":0,"ondisk_log_size":3115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3188,"num_write_kb":38703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"41'3651","reported_seq":2949,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.749771+0000","last_change":"2024-04-25T15:30:38.749822+0000","last_active":"2024-04-25T15:30:38.749771+0000","last_peered":"2024-04-25T15:30:38.749771+0000","last_clean":"2024-04-25T15:30:38.749771+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:30:38.749771+0000","last_undegraded":"2024-04-25T15:30:38.749771+0000","last_fullsized":"2024-04-25T15:30:38.749771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3651,"log_dups_size":0,"ondisk_log_size":3651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:27.011814+0000","scrub_duration":0,"objects_trimmed":658,"snaptrim_duration":8.1500825540000008,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.17","version":"40'1109","reported_seq":1169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602496+0000","last_change":"2024-04-25T15:20:41.406067+0000","last_active":"2024-04-25T15:30:30.602496+0000","last_peered":"2024-04-25T15:30:30.602496+0000","last_clean":"2024-04-25T15:30:30.602496+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:30:30.602496+0000","last_undegraded":"2024-04-25T15:30:30.602496+0000","last_fullsized":"2024-04-25T15:30:30.602496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1182,"num_write_kb":13307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"41'2914","reported_seq":2378,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.797642+0000","last_change":"2024-04-25T15:30:35.649216+0000","last_active":"2024-04-25T15:30:36.797642+0000","last_peered":"2024-04-25T15:30:36.797642+0000","last_clean":"2024-04-25T15:30:36.797642+0000","last_became_active":"2024-04-25T15:21:23.536519+0000","last_became_peered":"2024-04-25T15:21:23.536519+0000","last_unstale":"2024-04-25T15:30:36.797642+0000","last_undegraded":"2024-04-25T15:30:36.797642+0000","last_fullsized":"2024-04-25T15:30:36.797642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2914,"log_dups_size":0,"ondisk_log_size":2914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.188818+0000","scrub_duration":0,"objects_trimmed":229,"snaptrim_duration":5.0480612520000001,"stat_sum":{"num_bytes":6676,"num_objects":432,"num_object_clones":215,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":215,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.16","version":"40'1813","reported_seq":1873,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593511+0000","last_change":"2024-04-25T15:20:41.410325+0000","last_active":"2024-04-25T15:30:30.593511+0000","last_peered":"2024-04-25T15:30:30.593511+0000","last_clean":"2024-04-25T15:30:30.593511+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:30:30.593511+0000","last_undegraded":"2024-04-25T15:30:30.593511+0000","last_fullsized":"2024-04-25T15:30:30.593511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1874,"num_write_kb":25731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"41'3084","reported_seq":2484,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.796302+0000","last_change":"2024-04-25T15:30:34.106253+0000","last_active":"2024-04-25T15:30:36.796302+0000","last_peered":"2024-04-25T15:30:36.796302+0000","last_clean":"2024-04-25T15:30:36.796302+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:30:36.796302+0000","last_undegraded":"2024-04-25T15:30:36.796302+0000","last_fullsized":"2024-04-25T15:30:36.796302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3084,"log_dups_size":0,"ondisk_log_size":3084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:46:23.746310+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":3.513388913,"stat_sum":{"num_bytes":2839,"num_objects":470,"num_object_clones":235,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":470,"num_whiteouts":234,"num_read":3,"num_read_kb":2,"num_write":1199,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.15","version":"40'3249","reported_seq":3308,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600801+0000","last_change":"2024-04-25T15:20:41.415893+0000","last_active":"2024-04-25T15:30:30.600801+0000","last_peered":"2024-04-25T15:30:30.600801+0000","last_clean":"2024-04-25T15:30:30.600801+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:30:30.600801+0000","last_undegraded":"2024-04-25T15:30:30.600801+0000","last_fullsized":"2024-04-25T15:30:30.600801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3249,"log_dups_size":0,"ondisk_log_size":3249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3319,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'3965","reported_seq":3179,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676280+0000","last_change":"2024-04-25T15:30:38.676764+0000","last_active":"2024-04-25T15:30:38.676280+0000","last_peered":"2024-04-25T15:30:38.676280+0000","last_clean":"2024-04-25T15:30:38.676280+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:30:38.676280+0000","last_undegraded":"2024-04-25T15:30:38.676280+0000","last_fullsized":"2024-04-25T15:30:38.676280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3965,"log_dups_size":0,"ondisk_log_size":3965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:50.458209+0000","scrub_duration":0,"objects_trimmed":757,"snaptrim_duration":8.0786606909999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.14","version":"41'5275","reported_seq":5335,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.604978+0000","last_change":"2024-04-25T15:20:41.406750+0000","last_active":"2024-04-25T15:30:30.604978+0000","last_peered":"2024-04-25T15:30:30.604978+0000","last_clean":"2024-04-25T15:30:30.604978+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:30:30.604978+0000","last_undegraded":"2024-04-25T15:30:30.604978+0000","last_fullsized":"2024-04-25T15:30:30.604978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":5332,"num_write_kb":30677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"41'3520","reported_seq":2810,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.829353+0000","last_change":"2024-04-25T15:30:38.877873+0000","last_active":"2024-04-25T15:30:39.829353+0000","last_peered":"2024-04-25T15:30:39.829353+0000","last_clean":"2024-04-25T15:30:39.829353+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:30:39.829353+0000","last_undegraded":"2024-04-25T15:30:39.829353+0000","last_fullsized":"2024-04-25T15:30:39.829353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3520,"log_dups_size":0,"ondisk_log_size":3520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:40.123031+0000","scrub_duration":0,"objects_trimmed":598,"snaptrim_duration":1.615482919,"stat_sum":{"num_bytes":696,"num_objects":118,"num_object_clones":59,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":59,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.13","version":"40'2601","reported_seq":2661,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.594170+0000","last_change":"2024-04-25T15:20:41.401705+0000","last_active":"2024-04-25T15:30:30.594170+0000","last_peered":"2024-04-25T15:30:30.594170+0000","last_clean":"2024-04-25T15:30:30.594170+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:30:30.594170+0000","last_undegraded":"2024-04-25T15:30:30.594170+0000","last_fullsized":"2024-04-25T15:30:30.594170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":2688,"num_write_kb":17973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"41'2843","reported_seq":2289,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.820025+0000","last_change":"2024-04-25T15:30:36.212116+0000","last_active":"2024-04-25T15:30:36.820025+0000","last_peered":"2024-04-25T15:30:36.820025+0000","last_clean":"2024-04-25T15:30:36.820025+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:30:36.820025+0000","last_undegraded":"2024-04-25T15:30:36.820025+0000","last_fullsized":"2024-04-25T15:30:36.820025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2843,"log_dups_size":0,"ondisk_log_size":2843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:57.104366+0000","scrub_duration":0,"objects_trimmed":240,"snaptrim_duration":5.6185218160000003,"stat_sum":{"num_bytes":2729,"num_objects":450,"num_object_clones":225,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":224,"num_read":4,"num_read_kb":3,"num_write":1228,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.12","version":"40'111","reported_seq":171,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593646+0000","last_change":"2024-04-25T15:20:41.409212+0000","last_active":"2024-04-25T15:30:30.593646+0000","last_peered":"2024-04-25T15:30:30.593646+0000","last_clean":"2024-04-25T15:30:30.593646+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:30:30.593646+0000","last_undegraded":"2024-04-25T15:30:30.593646+0000","last_fullsized":"2024-04-25T15:30:30.593646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":196,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"41'3627","reported_seq":2962,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.763179+0000","last_change":"2024-04-25T15:30:36.524583+0000","last_active":"2024-04-25T15:30:36.763179+0000","last_peered":"2024-04-25T15:30:36.763179+0000","last_clean":"2024-04-25T15:30:36.763179+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:30:36.763179+0000","last_undegraded":"2024-04-25T15:30:36.763179+0000","last_fullsized":"2024-04-25T15:30:36.763179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:43.450201+0000","scrub_duration":0,"objects_trimmed":264,"snaptrim_duration":5.9252819609999996,"stat_sum":{"num_bytes":2963,"num_objects":495,"num_object_clones":247,"num_object_copies":990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":495,"num_whiteouts":246,"num_read":0,"num_read_kb":0,"num_write":1302,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.11","version":"40'1074","reported_seq":1134,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602130+0000","last_change":"2024-04-25T15:20:41.402015+0000","last_active":"2024-04-25T15:30:30.602130+0000","last_peered":"2024-04-25T15:30:30.602130+0000","last_clean":"2024-04-25T15:30:30.602130+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:30:30.602130+0000","last_undegraded":"2024-04-25T15:30:30.602130+0000","last_fullsized":"2024-04-25T15:30:30.602130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1158,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"41'3313","reported_seq":2636,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.788145+0000","last_change":"2024-04-25T15:30:39.082197+0000","last_active":"2024-04-25T15:30:39.788145+0000","last_peered":"2024-04-25T15:30:39.788145+0000","last_clean":"2024-04-25T15:30:39.788145+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:30:39.788145+0000","last_undegraded":"2024-04-25T15:30:39.788145+0000","last_fullsized":"2024-04-25T15:30:39.788145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:52.269365+0000","scrub_duration":0,"objects_trimmed":483,"snaptrim_duration":5.3086005309999997,"stat_sum":{"num_bytes":1128,"num_objects":188,"num_object_clones":94,"num_object_copies":376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":188,"num_whiteouts":94,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.10","version":"40'1015","reported_seq":1074,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.607771+0000","last_change":"2024-04-25T15:20:41.408427+0000","last_active":"2024-04-25T15:30:30.607771+0000","last_peered":"2024-04-25T15:30:30.607771+0000","last_clean":"2024-04-25T15:30:30.607771+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:30:30.607771+0000","last_undegraded":"2024-04-25T15:30:30.607771+0000","last_fullsized":"2024-04-25T15:30:30.607771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1107,"num_write_kb":8933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"41'3012","reported_seq":2410,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.813421+0000","last_change":"2024-04-25T15:30:34.399393+0000","last_active":"2024-04-25T15:30:36.813421+0000","last_peered":"2024-04-25T15:30:36.813421+0000","last_clean":"2024-04-25T15:30:36.813421+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:30:36.813421+0000","last_undegraded":"2024-04-25T15:30:36.813421+0000","last_fullsized":"2024-04-25T15:30:36.813421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3012,"log_dups_size":0,"ondisk_log_size":3012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:38.071652+0000","scrub_duration":0,"objects_trimmed":244,"snaptrim_duration":3.8010930269999998,"stat_sum":{"num_bytes":2784,"num_objects":467,"num_object_clones":232,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":232,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.f","version":"40'1305","reported_seq":1365,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.597526+0000","last_change":"2024-04-25T15:20:41.405515+0000","last_active":"2024-04-25T15:30:30.597526+0000","last_peered":"2024-04-25T15:30:30.597526+0000","last_clean":"2024-04-25T15:30:30.597526+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:30:30.597526+0000","last_undegraded":"2024-04-25T15:30:30.597526+0000","last_fullsized":"2024-04-25T15:30:30.597526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1305,"log_dups_size":0,"ondisk_log_size":1305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":1351,"num_write_kb":8728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"41'3157","reported_seq":2502,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.076092+0000","last_change":"2024-04-25T15:30:38.076135+0000","last_active":"2024-04-25T15:30:38.076092+0000","last_peered":"2024-04-25T15:30:38.076092+0000","last_clean":"2024-04-25T15:30:38.076092+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:30:38.076092+0000","last_undegraded":"2024-04-25T15:30:38.076092+0000","last_fullsized":"2024-04-25T15:30:38.076092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3157,"log_dups_size":0,"ondisk_log_size":3157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:57.855461+0000","scrub_duration":0,"objects_trimmed":256,"snaptrim_duration":7.4762973989999999,"stat_sum":{"num_bytes":2894,"num_objects":483,"num_object_clones":240,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":483,"num_whiteouts":240,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.e","version":"40'2474","reported_seq":2533,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.607786+0000","last_change":"2024-04-25T15:20:41.406806+0000","last_active":"2024-04-25T15:30:30.607786+0000","last_peered":"2024-04-25T15:30:30.607786+0000","last_clean":"2024-04-25T15:30:30.607786+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:30:30.607786+0000","last_undegraded":"2024-04-25T15:30:30.607786+0000","last_fullsized":"2024-04-25T15:30:30.607786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2474,"log_dups_size":0,"ondisk_log_size":2474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2548,"num_write_kb":13580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"41'2993","reported_seq":2435,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.508105+0000","last_change":"2024-04-25T15:30:39.508145+0000","last_active":"2024-04-25T15:30:39.508105+0000","last_peered":"2024-04-25T15:30:39.508105+0000","last_clean":"2024-04-25T15:30:39.508105+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:30:39.508105+0000","last_undegraded":"2024-04-25T15:30:39.508105+0000","last_fullsized":"2024-04-25T15:30:39.508105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2993,"log_dups_size":0,"ondisk_log_size":2993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:39:13.576915+0000","scrub_duration":0,"objects_trimmed":250,"snaptrim_duration":8.9069907399999995,"stat_sum":{"num_bytes":6889,"num_objects":467,"num_object_clones":232,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":231,"num_read":2,"num_read_kb":1,"num_write":1224,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.d","version":"40'4442","reported_seq":4501,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600901+0000","last_change":"2024-04-25T15:20:41.410562+0000","last_active":"2024-04-25T15:30:30.600901+0000","last_peered":"2024-04-25T15:30:30.600901+0000","last_clean":"2024-04-25T15:30:30.600901+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:30:30.600901+0000","last_undegraded":"2024-04-25T15:30:30.600901+0000","last_fullsized":"2024-04-25T15:30:30.600901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583135,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":4527,"num_write_kb":26836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"41'3079","reported_seq":2481,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.081368+0000","last_change":"2024-04-25T15:30:37.081413+0000","last_active":"2024-04-25T15:30:37.081368+0000","last_peered":"2024-04-25T15:30:37.081368+0000","last_clean":"2024-04-25T15:30:37.081368+0000","last_became_active":"2024-04-25T15:21:23.537569+0000","last_became_peered":"2024-04-25T15:21:23.537569+0000","last_unstale":"2024-04-25T15:30:37.081368+0000","last_undegraded":"2024-04-25T15:30:37.081368+0000","last_fullsized":"2024-04-25T15:30:37.081368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3079,"log_dups_size":0,"ondisk_log_size":3079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:57.114192+0000","scrub_duration":0,"objects_trimmed":262,"snaptrim_duration":6.4871342199999997,"stat_sum":{"num_bytes":2760,"num_objects":462,"num_object_clones":230,"num_object_copies":924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":462,"num_whiteouts":230,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.c","version":"40'2074","reported_seq":2133,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.611756+0000","last_change":"2024-04-25T15:20:41.404065+0000","last_active":"2024-04-25T15:30:30.611756+0000","last_peered":"2024-04-25T15:30:30.611756+0000","last_clean":"2024-04-25T15:30:30.611756+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:30:30.611756+0000","last_undegraded":"2024-04-25T15:30:30.611756+0000","last_fullsized":"2024-04-25T15:30:30.611756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":2143,"num_write_kb":17826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'3058","reported_seq":2449,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.782748+0000","last_change":"2024-04-25T15:30:33.086094+0000","last_active":"2024-04-25T15:30:36.782748+0000","last_peered":"2024-04-25T15:30:36.782748+0000","last_clean":"2024-04-25T15:30:36.782748+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:30:36.782748+0000","last_undegraded":"2024-04-25T15:30:36.782748+0000","last_fullsized":"2024-04-25T15:30:36.782748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:16.090008+0000","scrub_duration":0,"objects_trimmed":246,"snaptrim_duration":2.487939248,"stat_sum":{"num_bytes":6832,"num_objects":457,"num_object_clones":228,"num_object_copies":914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":228,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602229+0000","last_change":"2024-04-25T15:20:30.873208+0000","last_active":"2024-04-25T15:30:30.602229+0000","last_peered":"2024-04-25T15:30:30.602229+0000","last_clean":"2024-04-25T15:30:30.602229+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:30:30.602229+0000","last_undegraded":"2024-04-25T15:30:30.602229+0000","last_fullsized":"2024-04-25T15:30:30.602229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_clean_scrub_stamp":"2024-04-25T15:20:29.835147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:59.356200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"40'1171","reported_seq":1231,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593277+0000","last_change":"2024-04-25T15:20:41.403922+0000","last_active":"2024-04-25T15:30:30.593277+0000","last_peered":"2024-04-25T15:30:30.593277+0000","last_clean":"2024-04-25T15:30:30.593277+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:30:30.593277+0000","last_undegraded":"2024-04-25T15:30:30.593277+0000","last_fullsized":"2024-04-25T15:30:30.593277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1252,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"41'2570","reported_seq":2122,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.823536+0000","last_change":"2024-04-25T15:30:30.590019+0000","last_active":"2024-04-25T15:30:36.823536+0000","last_peered":"2024-04-25T15:30:36.823536+0000","last_clean":"2024-04-25T15:30:36.823536+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:30:36.823536+0000","last_undegraded":"2024-04-25T15:30:36.823536+0000","last_fullsized":"2024-04-25T15:30:36.823536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2570,"log_dups_size":0,"ondisk_log_size":2570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:33.739781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.6625848130000001,"stat_sum":{"num_bytes":5283,"num_objects":698,"num_object_clones":460,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":698,"num_whiteouts":237,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"41'3615","reported_seq":3675,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:36.643537+0000","last_change":"2024-04-25T15:20:41.410568+0000","last_active":"2024-04-25T15:30:36.643537+0000","last_peered":"2024-04-25T15:30:36.643537+0000","last_clean":"2024-04-25T15:30:36.643537+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:30:36.643537+0000","last_undegraded":"2024-04-25T15:30:36.643537+0000","last_fullsized":"2024-04-25T15:30:36.643537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6520497,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":3670,"num_write_kb":20386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"41'3126","reported_seq":2493,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.769564+0000","last_change":"2024-04-25T15:30:33.021932+0000","last_active":"2024-04-25T15:30:36.769564+0000","last_peered":"2024-04-25T15:30:36.769564+0000","last_clean":"2024-04-25T15:30:36.769564+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:30:36.769564+0000","last_undegraded":"2024-04-25T15:30:36.769564+0000","last_fullsized":"2024-04-25T15:30:36.769564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3126,"log_dups_size":0,"ondisk_log_size":3126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:46.761461+0000","scrub_duration":0,"objects_trimmed":238,"snaptrim_duration":2.4295429180000001,"stat_sum":{"num_bytes":2760,"num_objects":460,"num_object_clones":230,"num_object_copies":920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":460,"num_whiteouts":230,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1","version":"40'2374","reported_seq":2747,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.608333+0000","last_change":"2024-04-25T15:20:41.406046+0000","last_active":"2024-04-25T15:30:30.608333+0000","last_peered":"2024-04-25T15:30:30.608333+0000","last_clean":"2024-04-25T15:30:30.608333+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:30:30.608333+0000","last_undegraded":"2024-04-25T15:30:30.608333+0000","last_fullsized":"2024-04-25T15:30:30.608333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2374,"log_dups_size":0,"ondisk_log_size":2374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11691863,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":329,"num_read_kb":3430,"num_write":2430,"num_write_kb":16848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"41'3413","reported_seq":2728,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.608544+0000","last_change":"2024-04-25T15:30:37.608587+0000","last_active":"2024-04-25T15:30:37.608544+0000","last_peered":"2024-04-25T15:30:37.608544+0000","last_clean":"2024-04-25T15:30:37.608544+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:30:37.608544+0000","last_undegraded":"2024-04-25T15:30:37.608544+0000","last_fullsized":"2024-04-25T15:30:37.608544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:20.257648+0000","scrub_duration":0,"objects_trimmed":723,"snaptrim_duration":7.0088171780000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.2","version":"40'6781","reported_seq":6841,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.594013+0000","last_change":"2024-04-25T15:20:41.410676+0000","last_active":"2024-04-25T15:30:30.594013+0000","last_peered":"2024-04-25T15:30:30.594013+0000","last_clean":"2024-04-25T15:30:30.594013+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:30:30.594013+0000","last_undegraded":"2024-04-25T15:30:30.594013+0000","last_fullsized":"2024-04-25T15:30:30.594013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6781,"log_dups_size":0,"ondisk_log_size":6781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":6828,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"41'3641","reported_seq":2884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676561+0000","last_change":"2024-04-25T15:30:38.676800+0000","last_active":"2024-04-25T15:30:38.676561+0000","last_peered":"2024-04-25T15:30:38.676561+0000","last_clean":"2024-04-25T15:30:38.676561+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:30:38.676561+0000","last_undegraded":"2024-04-25T15:30:38.676561+0000","last_fullsized":"2024-04-25T15:30:38.676561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.134412+0000","scrub_duration":0,"objects_trimmed":737,"snaptrim_duration":8.0788980660000007,"stat_sum":{"num_bytes":21,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1263,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.4","version":"40'144","reported_seq":203,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599943+0000","last_change":"2024-04-25T15:20:41.413703+0000","last_active":"2024-04-25T15:30:30.599943+0000","last_peered":"2024-04-25T15:30:30.599943+0000","last_clean":"2024-04-25T15:30:30.599943+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:30:30.599943+0000","last_undegraded":"2024-04-25T15:30:30.599943+0000","last_fullsized":"2024-04-25T15:30:30.599943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":208,"num_write_kb":8700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"41'2817","reported_seq":2279,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:37.562635+0000","last_change":"2024-04-25T15:30:37.562677+0000","last_active":"2024-04-25T15:30:37.562635+0000","last_peered":"2024-04-25T15:30:37.562635+0000","last_clean":"2024-04-25T15:30:37.562635+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:30:37.562635+0000","last_undegraded":"2024-04-25T15:30:37.562635+0000","last_fullsized":"2024-04-25T15:30:37.562635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2817,"log_dups_size":0,"ondisk_log_size":2817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:53.738899+0000","scrub_duration":0,"objects_trimmed":229,"snaptrim_duration":6.9682819660000002,"stat_sum":{"num_bytes":10772,"num_objects":435,"num_object_clones":217,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":216,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.5","version":"40'1973","reported_seq":2033,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598648+0000","last_change":"2024-04-25T15:20:41.408759+0000","last_active":"2024-04-25T15:30:30.598648+0000","last_peered":"2024-04-25T15:30:30.598648+0000","last_clean":"2024-04-25T15:30:30.598648+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:30:30.598648+0000","last_undegraded":"2024-04-25T15:30:30.598648+0000","last_fullsized":"2024-04-25T15:30:30.598648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1973,"log_dups_size":0,"ondisk_log_size":1973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:41.992733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2030,"num_write_kb":21675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"41'3370","reported_seq":2703,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.816380+0000","last_change":"2024-04-25T15:30:38.749936+0000","last_active":"2024-04-25T15:30:39.816380+0000","last_peered":"2024-04-25T15:30:39.816380+0000","last_clean":"2024-04-25T15:30:39.816380+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:30:39.816380+0000","last_undegraded":"2024-04-25T15:30:39.816380+0000","last_fullsized":"2024-04-25T15:30:39.816380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3370,"log_dups_size":0,"ondisk_log_size":3370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:26.387482+0000","scrub_duration":0,"objects_trimmed":590,"snaptrim_duration":3.4419109580000002,"stat_sum":{"num_bytes":600,"num_objects":102,"num_object_clones":51,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":51,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.6","version":"41'2504","reported_seq":2563,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.601549+0000","last_change":"2024-04-25T15:20:41.409877+0000","last_active":"2024-04-25T15:30:30.601549+0000","last_peered":"2024-04-25T15:30:30.601549+0000","last_clean":"2024-04-25T15:30:30.601549+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:30:30.601549+0000","last_undegraded":"2024-04-25T15:30:30.601549+0000","last_fullsized":"2024-04-25T15:30:30.601549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2504,"log_dups_size":0,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3243,"num_write_kb":16596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'2748","reported_seq":2258,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.840360+0000","last_change":"2024-04-25T15:30:39.401031+0000","last_active":"2024-04-25T15:30:39.840360+0000","last_peered":"2024-04-25T15:30:39.840360+0000","last_clean":"2024-04-25T15:30:39.840360+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:30:39.840360+0000","last_undegraded":"2024-04-25T15:30:39.840360+0000","last_fullsized":"2024-04-25T15:30:39.840360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2748,"log_dups_size":0,"ondisk_log_size":2748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.298428+0000","scrub_duration":0,"objects_trimmed":78,"snaptrim_duration":2.6626469959999999,"stat_sum":{"num_bytes":8735,"num_objects":640,"num_object_clones":400,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":640,"num_whiteouts":239,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"40'133","reported_seq":193,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602613+0000","last_change":"2024-04-25T15:20:41.410949+0000","last_active":"2024-04-25T15:30:30.602613+0000","last_peered":"2024-04-25T15:30:30.602613+0000","last_clean":"2024-04-25T15:30:30.602613+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:30:30.602613+0000","last_undegraded":"2024-04-25T15:30:30.602613+0000","last_fullsized":"2024-04-25T15:30:30.602613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":213,"num_write_kb":8722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"41'2840","reported_seq":2302,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.261992+0000","last_change":"2024-04-25T15:30:39.262015+0000","last_active":"2024-04-25T15:30:39.261992+0000","last_peered":"2024-04-25T15:30:39.261992+0000","last_clean":"2024-04-25T15:30:39.261992+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:39.261992+0000","last_undegraded":"2024-04-25T15:30:39.261992+0000","last_fullsized":"2024-04-25T15:30:39.261992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2840,"log_dups_size":0,"ondisk_log_size":2840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.556786+0000","scrub_duration":0,"objects_trimmed":222,"snaptrim_duration":8.6675915420000003,"stat_sum":{"num_bytes":2592,"num_objects":432,"num_object_clones":216,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":216,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.8","version":"40'1036","reported_seq":1096,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600029+0000","last_change":"2024-04-25T15:20:41.405078+0000","last_active":"2024-04-25T15:30:30.600029+0000","last_peered":"2024-04-25T15:30:30.600029+0000","last_clean":"2024-04-25T15:30:30.600029+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:30:30.600029+0000","last_undegraded":"2024-04-25T15:30:30.600029+0000","last_fullsized":"2024-04-25T15:30:30.600029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1104,"num_write_kb":9199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"41'3352","reported_seq":2651,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.171838+0000","last_change":"2024-04-25T15:30:39.172045+0000","last_active":"2024-04-25T15:30:39.171838+0000","last_peered":"2024-04-25T15:30:39.171838+0000","last_clean":"2024-04-25T15:30:39.171838+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:39.171838+0000","last_undegraded":"2024-04-25T15:30:39.171838+0000","last_fullsized":"2024-04-25T15:30:39.171838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:59.054566+0000","scrub_duration":0,"objects_trimmed":673,"snaptrim_duration":8.5715076529999994,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.9","version":"40'1878","reported_seq":1937,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599834+0000","last_change":"2024-04-25T15:20:41.411766+0000","last_active":"2024-04-25T15:30:30.599834+0000","last_peered":"2024-04-25T15:30:30.599834+0000","last_clean":"2024-04-25T15:30:30.599834+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:30:30.599834+0000","last_undegraded":"2024-04-25T15:30:30.599834+0000","last_fullsized":"2024-04-25T15:30:30.599834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":1954,"num_write_kb":17506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"41'2829","reported_seq":2287,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.836669+0000","last_change":"2024-04-25T15:30:38.771956+0000","last_active":"2024-04-25T15:30:39.836669+0000","last_peered":"2024-04-25T15:30:39.836669+0000","last_clean":"2024-04-25T15:30:39.836669+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:30:39.836669+0000","last_undegraded":"2024-04-25T15:30:39.836669+0000","last_fullsized":"2024-04-25T15:30:39.836669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2829,"log_dups_size":0,"ondisk_log_size":2829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:25.485998+0000","scrub_duration":0,"objects_trimmed":176,"snaptrim_duration":2.6649829270000001,"stat_sum":{"num_bytes":3554,"num_objects":537,"num_object_clones":302,"num_object_copies":1074,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":537,"num_whiteouts":234,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"40'3651","reported_seq":3710,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600436+0000","last_change":"2024-04-25T15:20:41.406926+0000","last_active":"2024-04-25T15:30:30.600436+0000","last_peered":"2024-04-25T15:30:30.600436+0000","last_clean":"2024-04-25T15:30:30.600436+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:30:30.600436+0000","last_undegraded":"2024-04-25T15:30:30.600436+0000","last_fullsized":"2024-04-25T15:30:30.600436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3651,"log_dups_size":0,"ondisk_log_size":3651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3718,"num_write_kb":26255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"41'2742","reported_seq":2232,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.853678+0000","last_change":"2024-04-25T15:30:36.468277+0000","last_active":"2024-04-25T15:30:36.853678+0000","last_peered":"2024-04-25T15:30:36.853678+0000","last_clean":"2024-04-25T15:30:36.853678+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:30:36.853678+0000","last_undegraded":"2024-04-25T15:30:36.853678+0000","last_fullsized":"2024-04-25T15:30:36.853678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2742,"log_dups_size":0,"ondisk_log_size":2742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:14.515815+0000","scrub_duration":0,"objects_trimmed":221,"snaptrim_duration":5.8786392230000004,"stat_sum":{"num_bytes":2436,"num_objects":408,"num_object_clones":204,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408,"num_whiteouts":204,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.b","version":"40'5227","reported_seq":5287,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599376+0000","last_change":"2024-04-25T15:20:41.408140+0000","last_active":"2024-04-25T15:30:30.599376+0000","last_peered":"2024-04-25T15:30:30.599376+0000","last_clean":"2024-04-25T15:30:30.599376+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:30:30.599376+0000","last_undegraded":"2024-04-25T15:30:30.599376+0000","last_fullsized":"2024-04-25T15:30:30.599376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":5301,"num_write_kb":30551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"41'3710","reported_seq":2942,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:38.060514+0000","last_change":"2024-04-25T15:30:38.060564+0000","last_active":"2024-04-25T15:30:38.060514+0000","last_peered":"2024-04-25T15:30:38.060514+0000","last_clean":"2024-04-25T15:30:38.060514+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:30:38.060514+0000","last_undegraded":"2024-04-25T15:30:38.060514+0000","last_fullsized":"2024-04-25T15:30:38.060514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.286828+0000","scrub_duration":0,"objects_trimmed":693,"snaptrim_duration":7.4581421309999998,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.1d","version":"41'2917","reported_seq":2396,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.809207+0000","last_change":"2024-04-25T15:30:35.988171+0000","last_active":"2024-04-25T15:30:36.809207+0000","last_peered":"2024-04-25T15:30:36.809207+0000","last_clean":"2024-04-25T15:30:36.809207+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:30:36.809207+0000","last_undegraded":"2024-04-25T15:30:36.809207+0000","last_fullsized":"2024-04-25T15:30:36.809207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2917,"log_dups_size":0,"ondisk_log_size":2917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:52.844251+0000","scrub_duration":0,"objects_trimmed":236,"snaptrim_duration":5.3939467600000004,"stat_sum":{"num_bytes":6688,"num_objects":440,"num_object_clones":218,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":218,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1c","version":"40'1127","reported_seq":1186,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.597966+0000","last_change":"2024-04-25T15:20:41.408459+0000","last_active":"2024-04-25T15:30:30.597966+0000","last_peered":"2024-04-25T15:30:30.597966+0000","last_clean":"2024-04-25T15:30:30.597966+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:30:30.597966+0000","last_undegraded":"2024-04-25T15:30:30.597966+0000","last_fullsized":"2024-04-25T15:30:30.597966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1211,"num_write_kb":4844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'3265","reported_seq":2622,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:39.550371+0000","last_change":"2024-04-25T15:30:39.550417+0000","last_active":"2024-04-25T15:30:39.550371+0000","last_peered":"2024-04-25T15:30:39.550371+0000","last_clean":"2024-04-25T15:30:39.550371+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:30:39.550371+0000","last_undegraded":"2024-04-25T15:30:39.550371+0000","last_fullsized":"2024-04-25T15:30:39.550371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3265,"log_dups_size":0,"ondisk_log_size":3265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:12.255072+0000","scrub_duration":0,"objects_trimmed":285,"snaptrim_duration":8.9557072630000008,"stat_sum":{"num_bytes":7324,"num_objects":540,"num_object_clones":269,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":269,"num_read":0,"num_read_kb":0,"num_write":1350,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1d","version":"40'8160","reported_seq":8219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598260+0000","last_change":"2024-04-25T15:20:41.408914+0000","last_active":"2024-04-25T15:30:30.598260+0000","last_peered":"2024-04-25T15:30:30.598260+0000","last_clean":"2024-04-25T15:30:30.598260+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:30:30.598260+0000","last_undegraded":"2024-04-25T15:30:30.598260+0000","last_fullsized":"2024-04-25T15:30:30.598260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":8160,"log_dups_size":0,"ondisk_log_size":8160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.598854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":8233,"num_write_kb":32021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"41'2841","reported_seq":2305,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:39.843142+0000","last_change":"2024-04-25T15:30:39.797864+0000","last_active":"2024-04-25T15:30:39.843142+0000","last_peered":"2024-04-25T15:30:39.843142+0000","last_clean":"2024-04-25T15:30:39.843142+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:30:39.843142+0000","last_undegraded":"2024-04-25T15:30:39.843142+0000","last_fullsized":"2024-04-25T15:30:39.843142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":2841,"log_dups_size":0,"ondisk_log_size":2841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:18.229589+0000","scrub_duration":0,"objects_trimmed":251,"snaptrim_duration":1.5925796669999999,"stat_sum":{"num_bytes":2508,"num_objects":419,"num_object_clones":209,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":209,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1e","version":"40'6121","reported_seq":6181,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589353+0000","last_change":"2024-04-25T15:20:41.405976+0000","last_active":"2024-04-25T15:30:30.589353+0000","last_peered":"2024-04-25T15:30:30.589353+0000","last_clean":"2024-04-25T15:30:30.589353+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:30:30.589353+0000","last_undegraded":"2024-04-25T15:30:30.589353+0000","last_fullsized":"2024-04-25T15:30:30.589353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6121,"log_dups_size":0,"ondisk_log_size":6121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":6190,"num_write_kb":31064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"41'3023","reported_seq":2424,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:36.767688+0000","last_change":"2024-04-25T15:30:35.716433+0000","last_active":"2024-04-25T15:30:36.767688+0000","last_peered":"2024-04-25T15:30:36.767688+0000","last_clean":"2024-04-25T15:30:36.767688+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:30:36.767688+0000","last_undegraded":"2024-04-25T15:30:36.767688+0000","last_fullsized":"2024-04-25T15:30:36.767688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3023,"log_dups_size":0,"ondisk_log_size":3023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:17.235338+0000","scrub_duration":0,"objects_trimmed":234,"snaptrim_duration":5.1271952929999998,"stat_sum":{"num_bytes":6664,"num_objects":429,"num_object_clones":214,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":429,"num_whiteouts":214,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1f","version":"40'2537","reported_seq":2597,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593005+0000","last_change":"2024-04-25T15:20:41.410750+0000","last_active":"2024-04-25T15:30:30.593005+0000","last_peered":"2024-04-25T15:30:30.593005+0000","last_clean":"2024-04-25T15:30:30.593005+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:30:30.593005+0000","last_undegraded":"2024-04-25T15:30:30.593005+0000","last_fullsized":"2024-04-25T15:30:30.593005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2537,"log_dups_size":0,"ondisk_log_size":2537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2610,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":250090,"num_objects":20120,"num_object_clones":10299,"num_object_copies":40240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20120,"num_whiteouts":9706,"num_read":44,"num_read_kb":30,"num_write":77732,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84484096,"data_stored":499700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203889,"ondisk_log_size":203889,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":265677919,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":835,"num_read_kb":3430,"num_write":91102,"num_write_kb":583108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":531415040,"data_stored":531355838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88184,"ondisk_log_size":88184,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":416236,"kb_used_data":82404,"kb_used_omap":1,"kb_used_meta":333822,"kb_avail":93955604,"statfs":{"total":96636764160,"available":96210538496,"internally_reserved":0,"allocated":84381696,"data_stored":66132745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":341834186},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396336,"kb_used_data":86120,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":93975504,"statfs":{"total":96636764160,"available":96230916096,"internally_reserved":0,"allocated":88186880,"data_stored":84126126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574973,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":388852,"kb_used_data":96684,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93982988,"statfs":{"total":96636764160,"available":96238579712,"internally_reserved":0,"allocated":99004416,"data_stored":84177428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574973,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411104,"kb_used_data":73108,"kb_used_omap":1,"kb_used_meta":337982,"kb_avail":93960736,"statfs":{"total":96636764160,"available":96215793664,"internally_reserved":0,"allocated":74862592,"data_stored":63176542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346094022},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,3,3,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391964,"kb_used_data":85968,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93979876,"statfs":{"total":96636764160,"available":96235393024,"internally_reserved":0,"allocated":88031232,"data_stored":70719157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":313326023},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188228,"kb_used_data":40508,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94183612,"statfs":{"total":96636764160,"available":96444018688,"internally_reserved":0,"allocated":41480192,"data_stored":37093920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":407400,"kb_used_data":91608,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93964440,"statfs":{"total":96636764160,"available":96219586560,"internally_reserved":0,"allocated":93806592,"data_stored":86453251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":323353029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326652,"kb_used_data":56748,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94045188,"statfs":{"total":96636764160,"available":96302272512,"internally_reserved":0,"allocated":58109952,"data_stored":42806283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86220800,"data_stored":86212586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36859904,"data_stored":36857687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70422528,"data_stored":70412791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62926848,"data_stored":62914839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83890176,"data_stored":83886170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83894272,"data_stored":83886752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65245184,"data_stored":65241335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14450688,"data_stored":66754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5922816,"data_stored":33618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3985408,"data_stored":32095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15921152,"data_stored":99292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10637312,"data_stored":55684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14123008,"data_stored":86097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3084288,"data_stored":33556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16359424,"data_stored":92604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:30:43.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:30:44.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.013+0000 7f743e122640 1 Processor -- start 2024-04-25T15:30:44.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.014+0000 7f743e122640 1 -- start start 2024-04-25T15:30:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.015+0000 7f743e122640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74300066c0 0x7f7430038490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.015+0000 7f743e122640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74300c9bd0 0x7f74300c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.015+0000 7f743e122640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7430037410 con 0x7f74300c3590 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.015+0000 7f743e122640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f74300c40b0 con 0x7f74300c9bd0 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.015+0000 7f743e122640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7430037a60 con 0x7f74300066c0 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.015+0000 7f743d120640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74300066c0 0x7f7430038490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.015+0000 7f743c91f640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74300c9bd0 0x7f74300c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.016+0000 7f743d120640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74300066c0 0x7f7430038490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:56656/0 (socket says 172.21.15.33:56656) 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.016+0000 7f743d120640 1 -- 172.21.15.33:0/942643565 learned_addr learned my addr 172.21.15.33:0/942643565 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.016+0000 7f743c91f640 1 -- 172.21.15.33:0/942643565 >> v2:172.21.15.155:3300/0 conn(0x7f74300066c0 msgr2=0x7f7430038490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.016+0000 7f743c91f640 1 --2- 172.21.15.33:0/942643565 >> v2:172.21.15.155:3300/0 conn(0x7f74300066c0 0x7f7430038490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.016+0000 7f742ffff640 1 -- 172.21.15.33:0/942643565 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564900617 0 0) 0x7f7430037410 con 0x7f74300c3590 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.016+0000 7f743c91f640 1 -- 172.21.15.33:0/942643565 >> v1:172.21.15.155:6789/0 conn(0x7f74300c3590 legacy=0x7f74300c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.016+0000 7f743c91f640 1 -- 172.21.15.33:0/942643565 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74300376f0 con 0x7f74300c9bd0 2024-04-25T15:30:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.017+0000 7f743d120640 1 --2- 172.21.15.33:0/942643565 >> v2:172.21.15.155:3300/0 conn(0x7f74300066c0 0x7f7430038490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.018+0000 7f743c91f640 1 --2- 172.21.15.33:0/942643565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c9bd0 0x7f74300c9fe0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f743003a440 tx=0x7f742802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77aecd410bc4e63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.018+0000 7f742ffff640 1 -- 172.21.15.33:0/942643565 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428037070 con 0x7f74300c9bd0 2024-04-25T15:30:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.018+0000 7f742ffff640 1 -- 172.21.15.33:0/942643565 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7428032440 con 0x7f74300c9bd0 2024-04-25T15:30:44.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.019+0000 7f742ffff640 1 -- 172.21.15.33:0/942643565 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742802ae60 con 0x7f74300c9bd0 2024-04-25T15:30:44.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.019+0000 7f743e122640 1 -- 172.21.15.33:0/942643565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c9bd0 msgr2=0x7f74300c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:44.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.019+0000 7f743e122640 1 --2- 172.21.15.33:0/942643565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c9bd0 0x7f74300c9fe0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f743003a440 tx=0x7f742802a110 comp rx=0 tx=0).stop 2024-04-25T15:30:44.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.020+0000 7f743e122640 1 -- 172.21.15.33:0/942643565 shutdown_connections 2024-04-25T15:30:44.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.020+0000 7f743e122640 1 --2- 172.21.15.33:0/942643565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c9bd0 0x7f74300c9fe0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.020+0000 7f743e122640 1 --2- 172.21.15.33:0/942643565 >> v2:172.21.15.155:3300/0 conn(0x7f74300066c0 0x7f7430038490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.020+0000 7f743e122640 1 -- 172.21.15.33:0/942643565 >> 172.21.15.33:0/942643565 conn(0x7f743003ba30 msgr2=0x7f7430006cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:44.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.020+0000 7f743e122640 1 -- 172.21.15.33:0/942643565 shutdown_connections 2024-04-25T15:30:44.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.020+0000 7f743e122640 1 -- 172.21.15.33:0/942643565 wait complete. 2024-04-25T15:30:44.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.022+0000 7f743e122640 1 Processor -- start 2024-04-25T15:30:44.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.022+0000 7f743e122640 1 -- start start 2024-04-25T15:30:44.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743e122640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300066c0 0x7f7430162790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:44.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743e122640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c3590 0x7f7430030be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:44.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743e122640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74300c9bd0 0x7f74301659b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:44.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743e122640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f74300370a0 con 0x7f74300c3590 2024-04-25T15:30:44.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743e122640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7430006ad0 con 0x7f74300c9bd0 2024-04-25T15:30:44.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743e122640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7430037dd0 con 0x7f74300066c0 2024-04-25T15:30:44.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743c91f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c3590 0x7f7430030be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:44.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743d921640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74300c9bd0 0x7f74301659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:44.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743c91f640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c3590 0x7f7430030be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:45436/0 (socket says 172.21.15.33:45436) 2024-04-25T15:30:44.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.024+0000 7f743c91f640 1 -- 172.21.15.33:0/291390137 learned_addr learned my addr 172.21.15.33:0/291390137 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.025+0000 7f743c91f640 1 -- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300066c0 msgr2=0x7f7430162790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.025+0000 7f743c91f640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300066c0 0x7f7430162790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.025+0000 7f743c91f640 1 -- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74300c9bd0 msgr2=0x7f74301659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.025+0000 7f743c91f640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74300c9bd0 0x7f74301659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.025+0000 7f743c91f640 1 -- 172.21.15.33:0/291390137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74300cdaa0 con 0x7f74300c3590 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.025+0000 7f743c91f640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c3590 0x7f7430030be0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f7428035040 tx=0x7f74280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.025+0000 7f742dffb640 1 -- 172.21.15.33:0/291390137 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428037050 con 0x7f74300c3590 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.025+0000 7f743e122640 1 -- 172.21.15.33:0/291390137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7430162cd0 con 0x7f74300c3590 2024-04-25T15:30:44.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.026+0000 7f742dffb640 1 -- 172.21.15.33:0/291390137 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7428038040 con 0x7f74300c3590 2024-04-25T15:30:44.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.026+0000 7f743e122640 1 -- 172.21.15.33:0/291390137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74300cdd10 con 0x7f74300c3590 2024-04-25T15:30:44.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.026+0000 7f742dffb640 1 -- 172.21.15.33:0/291390137 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428004430 con 0x7f74300c3590 2024-04-25T15:30:44.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.028+0000 7f74237fe640 1 -- 172.21.15.33:0/291390137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74300059c0 con 0x7f74300c3590 2024-04-25T15:30:44.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.029+0000 7f742dffb640 1 -- 172.21.15.33:0/291390137 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7428030710 con 0x7f74300c3590 2024-04-25T15:30:44.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.029+0000 7f742dffb640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f741c0744e0 0x7f741c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:44.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.030+0000 7f742dffb640 1 -- 172.21.15.33:0/291390137 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f74280b5e50 con 0x7f74300c3590 2024-04-25T15:30:44.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.030+0000 7f743d120640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f741c0744e0 0x7f741c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:44.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.031+0000 7f743d120640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f741c0744e0 0x7f741c0769f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f743802e0e0 tx=0x7f74380517a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:44.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.038+0000 7f742dffb640 1 -- 172.21.15.33:0/291390137 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74280803e0 con 0x7f74300c3590 2024-04-25T15:30:44.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.391+0000 7f74237fe640 1 -- 172.21.15.33:0/291390137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7430162ee0 con 0x7f74300c3590 2024-04-25T15:30:44.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.393+0000 7f742dffb640 1 -- 172.21.15.33:0/291390137 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+17014 (secure 0 0 0) 0x7f742807fce0 con 0x7f74300c3590 2024-04-25T15:30:44.397 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:30:44.397 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:30:30.582237+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":51,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1370918468":"2024-04-25T16:24:51.186771+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":48,"length":4}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":48,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:30:44.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 -- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f741c0744e0 msgr2=0x7f741c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:44.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f741c0744e0 0x7f741c0769f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f743802e0e0 tx=0x7f74380517a0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 -- 172.21.15.33:0/291390137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c3590 msgr2=0x7f7430030be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:44.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c3590 0x7f7430030be0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f7428035040 tx=0x7f74280046c0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 -- 172.21.15.33:0/291390137 shutdown_connections 2024-04-25T15:30:44.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f741c0744e0 0x7f741c0769f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74300c9bd0 0x7f74301659b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74300c3590 0x7f7430030be0 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 --2- 172.21.15.33:0/291390137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74300066c0 0x7f7430162790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:44.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 -- 172.21.15.33:0/291390137 >> 172.21.15.33:0/291390137 conn(0x7f743003ba30 msgr2=0x7f74300397a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:44.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 -- 172.21.15.33:0/291390137 shutdown_connections 2024-04-25T15:30:44.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:44.397+0000 7f74237fe640 1 -- 172.21.15.33:0/291390137 wait complete. 2024-04-25T15:30:45.418 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T15:30:45.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:30:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.532+0000 7f8250067640 1 Processor -- start 2024-04-25T15:30:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.533+0000 7f8250067640 1 -- start start 2024-04-25T15:30:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f8250067640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8248141a10 0x7f82480b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f8250067640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 0x7f82480b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f8250067640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82480b8330 con 0x7f8248147590 2024-04-25T15:30:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f8250067640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f82480b7850 con 0x7f8248141a10 2024-04-25T15:30:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f8250067640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f82480b7b30 con 0x7f82480b9670 2024-04-25T15:30:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f824e604640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8248147590 0x7f82480b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48026/0 (socket says 172.21.15.33:48026) 2024-04-25T15:30:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f824e604640 1 -- 172.21.15.33:0/614814889 learned_addr learned my addr 172.21.15.33:0/614814889 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f824d602640 1 --2- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 0x7f82480b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f824de03640 1 --2- 172.21.15.33:0/614814889 >> v2:172.21.15.155:3300/0 conn(0x7f8248141a10 0x7f82480b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f824ce01640 1 -- 172.21.15.33:0/614814889 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539658520 0 0) 0x7f82480b8330 con 0x7f8248147590 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.534+0000 7f824ce01640 1 -- 172.21.15.33:0/614814889 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8234003520 con 0x7f8248147590 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.535+0000 7f824de03640 1 -- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 msgr2=0x7f82480b9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.535+0000 7f824de03640 1 --2- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 0x7f82480b9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.535+0000 7f824de03640 1 -- 172.21.15.33:0/614814889 >> v1:172.21.15.33:6789/0 conn(0x7f8248147590 legacy=0x7f82480b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.535+0000 7f824de03640 1 -- 172.21.15.33:0/614814889 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480b7e10 con 0x7f8248141a10 2024-04-25T15:30:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.535+0000 7f824d602640 1 --2- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 0x7f82480b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.536+0000 7f824de03640 1 --2- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248141a10 0x7f82480b85a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f82440097a0 tx=0x7f824402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd3393a8d57b9d3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.536+0000 7f824ce01640 1 -- 172.21.15.33:0/614814889 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244037070 con 0x7f8248141a10 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.536+0000 7f824ce01640 1 -- 172.21.15.33:0/614814889 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8244032440 con 0x7f8248141a10 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.536+0000 7f824ce01640 1 -- 172.21.15.33:0/614814889 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244032810 con 0x7f8248141a10 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.537+0000 7f8250067640 1 -- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248141a10 msgr2=0x7f82480b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.537+0000 7f8250067640 1 --2- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248141a10 0x7f82480b85a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f82440097a0 tx=0x7f824402a180 comp rx=0 tx=0).stop 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.537+0000 7f8250067640 1 -- 172.21.15.33:0/614814889 shutdown_connections 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.537+0000 7f8250067640 1 --2- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 0x7f82480b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.537+0000 7f8250067640 1 --2- 172.21.15.33:0/614814889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248141a10 0x7f82480b85a0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.537+0000 7f8250067640 1 -- 172.21.15.33:0/614814889 >> 172.21.15.33:0/614814889 conn(0x7f8248070430 msgr2=0x7f8248070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.537+0000 7f8250067640 1 -- 172.21.15.33:0/614814889 shutdown_connections 2024-04-25T15:30:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.537+0000 7f8250067640 1 -- 172.21.15.33:0/614814889 wait complete. 2024-04-25T15:30:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.538+0000 7f8250067640 1 Processor -- start 2024-04-25T15:30:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.538+0000 7f8250067640 1 -- start start 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.539+0000 7f8250067640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 0x7f82481dd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.539+0000 7f8250067640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8248141a10 0x7f82480b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.539+0000 7f8250067640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248147590 0x7f82480b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.539+0000 7f8250067640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f82480b8c60 con 0x7f8248141a10 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.539+0000 7f8250067640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f82480b8ae0 con 0x7f8248147590 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.539+0000 7f8250067640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f82481479a0 con 0x7f82480b9670 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.539+0000 7f824d602640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8248141a10 0x7f82480b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.539+0000 7f824d602640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8248141a10 0x7f82480b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54592/0 (socket says 172.21.15.33:54592) 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824d602640 1 -- 172.21.15.33:0/3682234557 learned_addr learned my addr 172.21.15.33:0/3682234557 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824e604640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248147590 0x7f82480b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824de03640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 0x7f82481dd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824d602640 1 -- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 msgr2=0x7f82481dd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824d602640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82480b9670 0x7f82481dd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824d602640 1 -- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248147590 msgr2=0x7f82480b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824d602640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248147590 0x7f82480b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824d602640 1 -- 172.21.15.33:0/3682234557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480b5f90 con 0x7f8248141a10 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824e604640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8248147590 0x7f82480b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f824d602640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8248141a10 0x7f82480b40a0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f823c00e990 tx=0x7f823c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c017070 con 0x7f8248141a10 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c00c980 con 0x7f8248141a10 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82481ddaa0 con 0x7f8248141a10 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c00cd50 con 0x7f8248141a10 2024-04-25T15:30:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.540+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82480b5bb0 con 0x7f8248141a10 2024-04-25T15:30:45.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.541+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82480764e0 con 0x7f8248141a10 2024-04-25T15:30:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.542+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f823c01a070 con 0x7f8248141a10 2024-04-25T15:30:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.542+0000 7f823a7fc640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f822c0744e0 0x7f822c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.543+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f823c0958f0 con 0x7f8248141a10 2024-04-25T15:30:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.543+0000 7f823a7fc640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7f822c07c9e0 0x7f822c07eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.543+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 --> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f822c07f5a0 con 0x7f822c07c9e0 2024-04-25T15:30:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.543+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f823c095d80 con 0x7f8248141a10 2024-04-25T15:30:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.543+0000 7f824de03640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f822c0744e0 0x7f822c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.543+0000 7f824e604640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7f822c07c9e0 0x7f822c07eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.543+0000 7f824e604640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7f822c07c9e0 0x7f822c07eed0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.543+0000 7f824de03640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f822c0744e0 0x7f822c0769f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8244034000 tx=0x7f824402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.544+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 <== osd.0 v2:172.21.15.33:6824/3758744180 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f822c07f5a0 con 0x7f822c07c9e0 2024-04-25T15:30:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.558+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 --> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f82480b6a20 con 0x7f822c07c9e0 2024-04-25T15:30:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.558+0000 7f823a7fc640 1 -- 172.21.15.33:0/3682234557 <== osd.0 v2:172.21.15.33:6824/3758744180 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f82480b6a20 con 0x7f822c07c9e0 2024-04-25T15:30:45.559 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:45.560 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:30:45.560 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.558+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7f822c07c9e0 msgr2=0x7f822c07eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.558+0000 7f8250067640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.33:6824/3758744180,v1:172.21.15.33:6825/3758744180] conn(0x7f822c07c9e0 0x7f822c07eed0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f822c0744e0 msgr2=0x7f822c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f8250067640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f822c0744e0 0x7f822c0769f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8244034000 tx=0x7f824402e000 comp rx=0 tx=0).stop 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8248141a10 msgr2=0x7f82480b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f8250067640 1 --2- 172.21.15.33:0/3682234557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8248141a10 0x7f82480b40a0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f823c00e990 tx=0x7f823c00ee50 comp rx=0 tx=0).stop 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f824e604640 1 -- 172.21.15.33:0/3682234557 reap_dead start 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 shutdown_connections 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 >> 172.21.15.33:0/3682234557 conn(0x7f8248070430 msgr2=0x7f82480bd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 shutdown_connections 2024-04-25T15:30:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.559+0000 7f8250067640 1 -- 172.21.15.33:0/3682234557 wait complete. 2024-04-25T15:30:45.571 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T15:30:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.681+0000 7f76037b2640 1 Processor -- start 2024-04-25T15:30:45.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.681+0000 7f76037b2640 1 -- start start 2024-04-25T15:30:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.682+0000 7f76037b2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.682+0000 7f76037b2640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75fc0b69f0 con 0x7f75fc0bc370 2024-04-25T15:30:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.682+0000 7f76037b2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75fc0b6cd0 con 0x7f75fc073150 2024-04-25T15:30:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.682+0000 7f76037b2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc073f30 con 0x7f75fc0bbf60 2024-04-25T15:30:45.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.682+0000 7f7601d4f640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f75fc0bc370 0x7f75fc154080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48042/0 (socket says 172.21.15.33:48042) 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.682+0000 7f7601d4f640 1 -- 172.21.15.33:0/3081641405 learned_addr learned my addr 172.21.15.33:0/3081641405 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.683+0000 7f7600d4d640 1 --2- 172.21.15.33:0/3081641405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.683+0000 7f75f3fff640 1 -- 172.21.15.33:0/3081641405 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471005935 0 0) 0x7f75fc0b69f0 con 0x7f75fc0bc370 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.683+0000 7f75f3fff640 1 -- 172.21.15.33:0/3081641405 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75e8003520 con 0x7f75fc0bc370 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.683+0000 7f75f3fff640 1 -- 172.21.15.33:0/3081641405 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128765772 0 0) 0x7f75fc0b6cd0 con 0x7f75fc073150 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.683+0000 7f75f3fff640 1 -- 172.21.15.33:0/3081641405 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75fc0b69f0 con 0x7f75fc073150 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.683+0000 7f7600d4d640 1 -- 172.21.15.33:0/3081641405 >> v1:172.21.15.155:6789/0 conn(0x7f75fc073150 legacy=0x7f75fc143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.683+0000 7f7600d4d640 1 -- 172.21.15.33:0/3081641405 >> v1:172.21.15.33:6789/0 conn(0x7f75fc0bc370 legacy=0x7f75fc154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.683+0000 7f7600d4d640 1 -- 172.21.15.33:0/3081641405 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc0b6680 con 0x7f75fc0bbf60 2024-04-25T15:30:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.684+0000 7f7600d4d640 1 --2- 172.21.15.33:0/3081641405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc14cd80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097d0 tx=0x7f75f802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ef42a026414d438 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.684+0000 7f75f3fff640 1 -- 172.21.15.33:0/3081641405 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8037070 con 0x7f75fc0bbf60 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.684+0000 7f75f3fff640 1 -- 172.21.15.33:0/3081641405 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f8032440 con 0x7f75fc0bbf60 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.684+0000 7f75f3fff640 1 -- 172.21.15.33:0/3081641405 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f80327f0 con 0x7f75fc0bbf60 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.684+0000 7f76037b2640 1 -- 172.21.15.33:0/3081641405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 msgr2=0x7f75fc14cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.684+0000 7f76037b2640 1 --2- 172.21.15.33:0/3081641405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc14cd80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097d0 tx=0x7f75f802a180 comp rx=0 tx=0).stop 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.685+0000 7f76037b2640 1 -- 172.21.15.33:0/3081641405 shutdown_connections 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.685+0000 7f76037b2640 1 --2- 172.21.15.33:0/3081641405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc14cd80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.685+0000 7f76037b2640 1 -- 172.21.15.33:0/3081641405 >> 172.21.15.33:0/3081641405 conn(0x7f75fc0b8b10 msgr2=0x7f75fc0bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.685+0000 7f76037b2640 1 -- 172.21.15.33:0/3081641405 shutdown_connections 2024-04-25T15:30:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.685+0000 7f76037b2640 1 -- 172.21.15.33:0/3081641405 wait complete. 2024-04-25T15:30:45.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.686+0000 7f76037b2640 1 Processor -- start 2024-04-25T15:30:45.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.686+0000 7f76037b2640 1 -- start start 2024-04-25T15:30:45.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f76037b2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75fc073150 0x7f75fc0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f76037b2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc1e0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f76037b2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0bc370 0x7f75fc140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f76037b2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc14d2c0 con 0x7f75fc073150 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f76037b2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc0b7040 con 0x7f75fc0bc370 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f76037b2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc14d440 con 0x7f75fc0bbf60 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f760154e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75fc073150 0x7f75fc0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f760154e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75fc073150 0x7f75fc0aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54602/0 (socket says 172.21.15.33:54602) 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f760154e640 1 -- 172.21.15.33:0/1438249916 learned_addr learned my addr 172.21.15.33:0/1438249916 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f7600d4d640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc1e0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.687+0000 7f7601d4f640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0bc370 0x7f75fc140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f760154e640 1 -- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 msgr2=0x7f75fc1e0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f760154e640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc1e0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f760154e640 1 -- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0bc370 msgr2=0x7f75fc140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f760154e640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0bc370 0x7f75fc140ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f760154e640 1 -- 172.21.15.33:0/1438249916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc1e0c80 con 0x7f75fc073150 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f760154e640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75fc073150 0x7f75fc0aeac0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00c460 tx=0x7f75ec00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f75f1ffb640 1 -- 172.21.15.33:0/1438249916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec017070 con 0x7f75fc073150 2024-04-25T15:30:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75fc0b1120 con 0x7f75fc073150 2024-04-25T15:30:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f75f1ffb640 1 -- 172.21.15.33:0/1438249916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec0052f0 con 0x7f75fc073150 2024-04-25T15:30:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f75f1ffb640 1 -- 172.21.15.33:0/1438249916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec003830 con 0x7f75fc073150 2024-04-25T15:30:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.688+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75fc0b1e10 con 0x7f75fc073150 2024-04-25T15:30:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.689+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75fc0764e0 con 0x7f75fc073150 2024-04-25T15:30:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.690+0000 7f75f1ffb640 1 -- 172.21.15.33:0/1438249916 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f75ec01a070 con 0x7f75fc073150 2024-04-25T15:30:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.691+0000 7f75f1ffb640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f75e00744b0 0x7f75e00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.691+0000 7f75f1ffb640 1 -- 172.21.15.33:0/1438249916 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f75ec094720 con 0x7f75fc073150 2024-04-25T15:30:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.691+0000 7f7600d4d640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f75e00744b0 0x7f75e00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.692+0000 7f7600d4d640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f75e00744b0 0x7f75e00769c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75f8034000 tx=0x7f75f802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.700+0000 7f75f1ffb640 1 -- 172.21.15.33:0/1438249916 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f75ec05e660 con 0x7f75fc073150 2024-04-25T15:30:45.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.885+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f75fc0bbbe0 con 0x7f75e00744b0 2024-04-25T15:30:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.885+0000 7f75f1ffb640 1 -- 172.21.15.33:0/1438249916 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f75fc0bbbe0 con 0x7f75e00744b0 2024-04-25T15:30:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T15:30:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f75e00744b0 msgr2=0x7f75e00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f75e00744b0 0x7f75e00769c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75f8034000 tx=0x7f75f802e000 comp rx=0 tx=0).stop 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75fc073150 msgr2=0x7f75fc0aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75fc073150 0x7f75fc0aeac0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00c460 tx=0x7f75ec00c920 comp rx=0 tx=0).stop 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 shutdown_connections 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f75e00744b0 0x7f75e00769c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75fc0bc370 0x7f75fc140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f75fc0bbf60 0x7f75fc1e0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 --2- 172.21.15.33:0/1438249916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75fc073150 0x7f75fc0aeac0 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.887+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 >> 172.21.15.33:0/1438249916 conn(0x7f75fc0b8b10 msgr2=0x7f75fc149ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.888+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 shutdown_connections 2024-04-25T15:30:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:45.888+0000 7f76037b2640 1 -- 172.21.15.33:0/1438249916 wait complete. 2024-04-25T15:30:45.900 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T15:30:45.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:30:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.015+0000 7f6436cd1640 1 Processor -- start 2024-04-25T15:30:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.015+0000 7f6436cd1640 1 -- start start 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f6436cd1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6430148180 0x7f64300b7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f6436cd1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b24b0 0x7f64300b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f6436cd1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64301476a0 con 0x7f64300b9560 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f6436cd1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f64300b2e00 con 0x7f6430148180 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f6436cd1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6430147cf0 con 0x7f64300b24b0 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f6434a6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6430148180 0x7f64300b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f643526e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b24b0 0x7f64300b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f6434a6d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6430148180 0x7f64300b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:51850/0 (socket says 172.21.15.33:51850) 2024-04-25T15:30:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f643526e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b24b0 0x7f64300b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.33:38988/0 (socket says 172.21.15.33:38988) 2024-04-25T15:30:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f6434a6d640 1 -- 172.21.15.33:0/498341799 learned_addr learned my addr 172.21.15.33:0/498341799 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.016+0000 7f642ffff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f64300b9560 0x7f64301414e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:44178/0 (socket says 172.21.15.33:44178) 2024-04-25T15:30:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.017+0000 7f643526e640 1 -- 172.21.15.33:0/498341799 >> v2:172.21.15.155:3300/0 conn(0x7f6430148180 msgr2=0x7f64300b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.017+0000 7f643526e640 1 --2- 172.21.15.33:0/498341799 >> v2:172.21.15.155:3300/0 conn(0x7f6430148180 0x7f64300b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.017+0000 7f643526e640 1 -- 172.21.15.33:0/498341799 >> v1:172.21.15.155:6789/0 conn(0x7f64300b9560 legacy=0x7f64301414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.017+0000 7f643526e640 1 -- 172.21.15.33:0/498341799 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6430147980 con 0x7f64300b24b0 2024-04-25T15:30:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.017+0000 7f6434a6d640 1 --2- 172.21.15.33:0/498341799 >> v2:172.21.15.155:3300/0 conn(0x7f6430148180 0x7f64300b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:46.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.017+0000 7f643526e640 1 --2- 172.21.15.33:0/498341799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b24b0 0x7f64300b28c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d90 tx=0x7f642802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7590195a38a2647f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f642f7fe640 1 -- 172.21.15.33:0/498341799 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428031600 con 0x7f64300b24b0 2024-04-25T15:30:46.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f642f7fe640 1 -- 172.21.15.33:0/498341799 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280317a0 con 0x7f64300b24b0 2024-04-25T15:30:46.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f642f7fe640 1 -- 172.21.15.33:0/498341799 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428031b70 con 0x7f64300b24b0 2024-04-25T15:30:46.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f6436cd1640 1 -- 172.21.15.33:0/498341799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b24b0 msgr2=0x7f64300b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f6436cd1640 1 --2- 172.21.15.33:0/498341799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b24b0 0x7f64300b28c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d90 tx=0x7f642802a5d0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f6436cd1640 1 -- 172.21.15.33:0/498341799 shutdown_connections 2024-04-25T15:30:46.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f6436cd1640 1 --2- 172.21.15.33:0/498341799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b24b0 0x7f64300b28c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f6436cd1640 1 --2- 172.21.15.33:0/498341799 >> v2:172.21.15.155:3300/0 conn(0x7f6430148180 0x7f64300b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f6436cd1640 1 -- 172.21.15.33:0/498341799 >> 172.21.15.33:0/498341799 conn(0x7f64300714a0 msgr2=0x7f64300718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f6436cd1640 1 -- 172.21.15.33:0/498341799 shutdown_connections 2024-04-25T15:30:46.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.018+0000 7f6436cd1640 1 -- 172.21.15.33:0/498341799 wait complete. 2024-04-25T15:30:46.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.020+0000 7f6436cd1640 1 Processor -- start 2024-04-25T15:30:46.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.020+0000 7f6436cd1640 1 -- start start 2024-04-25T15:30:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f6436cd1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64300b24b0 0x7f64300a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f6436cd1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b9560 0x7f64300a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f6436cd1640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6430148180 0x7f64300b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f6436cd1640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6430141bf0 con 0x7f6430148180 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f6436cd1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64300b9d60 con 0x7f64300b24b0 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f6436cd1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f64300a23a0 con 0x7f64300b9560 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f643526e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6430148180 0x7f64300b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f643526e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6430148180 0x7f64300b5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54608/0 (socket says 172.21.15.33:54608) 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f643526e640 1 -- 172.21.15.33:0/3748079196 learned_addr learned my addr 172.21.15.33:0/3748079196 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f6434a6d640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64300b24b0 0x7f64300a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f642ffff640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b9560 0x7f64300a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.021+0000 7f643526e640 1 -- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b9560 msgr2=0x7f64300a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f643526e640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64300b9560 0x7f64300a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f643526e640 1 -- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64300b24b0 msgr2=0x7f64300a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f643526e640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64300b24b0 0x7f64300a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f643526e640 1 -- 172.21.15.33:0/3748079196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64300a1ed0 con 0x7f6430148180 2024-04-25T15:30:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f643526e640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6430148180 0x7f64300b5f10 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f642802abc0 tx=0x7f6428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642803f070 con 0x7f6430148180 2024-04-25T15:30:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6428030b60 con 0x7f6430148180 2024-04-25T15:30:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64300b6d30 con 0x7f6430148180 2024-04-25T15:30:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428009450 con 0x7f6430148180 2024-04-25T15:30:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.022+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301e34d0 con 0x7f6430148180 2024-04-25T15:30:46.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.023+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64300764e0 con 0x7f6430148180 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.024+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f642803b410 con 0x7f6430148180 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.024+0000 7f642d7fa640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64140744b0 0x7f64140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.024+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f64280b6b20 con 0x7f6430148180 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.024+0000 7f6434a6d640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64140744b0 0x7f64140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.024+0000 7f642d7fa640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f641407c9b0 0x7f641407eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.024+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 --> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f641407f570 con 0x7f641407c9b0 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.024+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f64280b6fb0 con 0x7f6430148180 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.025+0000 7f642ffff640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f641407c9b0 0x7f641407eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.025+0000 7f6434a6d640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64140744b0 0x7f64140769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6424006cc0 tx=0x7f6424009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.025+0000 7f642ffff640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f641407c9b0 0x7f641407eea0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.026+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 <== osd.1 v2:172.21.15.33:6800/3783939985 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f641407f570 con 0x7f641407c9b0 2024-04-25T15:30:46.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.039+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 --> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f643013f9a0 con 0x7f641407c9b0 2024-04-25T15:30:46.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.039+0000 7f642d7fa640 1 -- 172.21.15.33:0/3748079196 <== osd.1 v2:172.21.15.33:6800/3783939985 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f643013f9a0 con 0x7f641407c9b0 2024-04-25T15:30:46.040 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:46.041 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:30:46.041 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.039+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f641407c9b0 msgr2=0x7f641407eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.039+0000 7f6436cd1640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.33:6800/3783939985,v1:172.21.15.33:6801/3783939985] conn(0x7f641407c9b0 0x7f641407eea0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64140744b0 msgr2=0x7f64140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f6436cd1640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f64140744b0 0x7f64140769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6424006cc0 tx=0x7f6424009240 comp rx=0 tx=0).stop 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6430148180 msgr2=0x7f64300b5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f6436cd1640 1 --2- 172.21.15.33:0/3748079196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6430148180 0x7f64300b5f10 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f642802abc0 tx=0x7f6428004a40 comp rx=0 tx=0).stop 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f643526e640 1 -- 172.21.15.33:0/3748079196 reap_dead start 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 shutdown_connections 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 >> 172.21.15.33:0/3748079196 conn(0x7f64300714a0 msgr2=0x7f64301408f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 shutdown_connections 2024-04-25T15:30:46.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.040+0000 7f6436cd1640 1 -- 172.21.15.33:0/3748079196 wait complete. 2024-04-25T15:30:46.051 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T15:30:46.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.162+0000 7fa92bfd5640 1 Processor -- start 2024-04-25T15:30:46.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.162+0000 7fa92bfd5640 1 -- start start 2024-04-25T15:30:46.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.163+0000 7fa92bfd5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9240bc430 0x7fa924146470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.163+0000 7fa92bfd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b7d80 0x7fa9240b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.163+0000 7fa92bfd5640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa9240b8190 0x7fa924072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.163+0000 7fa92bfd5640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fa924149a60 con 0x7fa9240b8190 2024-04-25T15:30:46.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92bfd5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa9240b31d0 con 0x7fa9240bc430 2024-04-25T15:30:46.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92bfd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa924149cb0 con 0x7fa9240b7d80 2024-04-25T15:30:46.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92a572640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa9240b8190 0x7fa924072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92a572640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa9240b8190 0x7fa924072520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54612/0 (socket says 172.21.15.33:54612) 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92a572640 1 -- 172.21.15.33:0/3386972187 learned_addr learned my addr 172.21.15.33:0/3386972187 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa929570640 1 --2- 172.21.15.33:0/3386972187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b7d80 0x7fa9240b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa929d71640 1 --2- 172.21.15.33:0/3386972187 >> v2:172.21.15.155:3300/0 conn(0x7fa9240bc430 0x7fa924146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92a572640 1 -- 172.21.15.33:0/3386972187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b7d80 msgr2=0x7fa9240b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92a572640 1 --2- 172.21.15.33:0/3386972187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b7d80 0x7fa9240b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92a572640 1 -- 172.21.15.33:0/3386972187 >> v2:172.21.15.155:3300/0 conn(0x7fa9240bc430 msgr2=0x7fa924146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92a572640 1 --2- 172.21.15.33:0/3386972187 >> v2:172.21.15.155:3300/0 conn(0x7fa9240bc430 0x7fa924146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa92a572640 1 -- 172.21.15.33:0/3386972187 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924149f90 con 0x7fa9240b8190 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa929d71640 1 --2- 172.21.15.33:0/3386972187 >> v2:172.21.15.155:3300/0 conn(0x7fa9240bc430 0x7fa924146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.164+0000 7fa929570640 1 --2- 172.21.15.33:0/3386972187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b7d80 0x7fa9240b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:30:46.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.165+0000 7fa92a572640 1 --2- 172.21.15.33:0/3386972187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240b8190 0x7fa924072520 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fa924074160 tx=0x7fa91c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439f1e36f8762cdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.165+0000 7fa928d6f640 1 -- 172.21.15.33:0/3386972187 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c036070 con 0x7fa9240b8190 2024-04-25T15:30:46.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.165+0000 7fa928d6f640 1 -- 172.21.15.33:0/3386972187 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91c031600 con 0x7fa9240b8190 2024-04-25T15:30:46.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.165+0000 7fa928d6f640 1 -- 172.21.15.33:0/3386972187 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0319d0 con 0x7fa9240b8190 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.165+0000 7fa92bfd5640 1 -- 172.21.15.33:0/3386972187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240b8190 msgr2=0x7fa924072520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.165+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/3386972187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240b8190 0x7fa924072520 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fa924074160 tx=0x7fa91c02a610 comp rx=0 tx=0).stop 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.166+0000 7fa92bfd5640 1 -- 172.21.15.33:0/3386972187 shutdown_connections 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.166+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/3386972187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240b8190 0x7fa924072520 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.166+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/3386972187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b7d80 0x7fa9240b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.166+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/3386972187 >> v2:172.21.15.155:3300/0 conn(0x7fa9240bc430 0x7fa924146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.166+0000 7fa92bfd5640 1 -- 172.21.15.33:0/3386972187 >> 172.21.15.33:0/3386972187 conn(0x7fa92406dd00 msgr2=0x7fa9240bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.166+0000 7fa92bfd5640 1 -- 172.21.15.33:0/3386972187 shutdown_connections 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.166+0000 7fa92bfd5640 1 -- 172.21.15.33:0/3386972187 wait complete. 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.167+0000 7fa92bfd5640 1 Processor -- start 2024-04-25T15:30:46.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.167+0000 7fa92bfd5640 1 -- start start 2024-04-25T15:30:46.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92bfd5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9240b7d80 0x7fa9241d3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92bfd5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b8190 0x7fa924147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92bfd5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240bc430 0x7fa92413ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92bfd5640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa9241469b0 con 0x7fa9240bc430 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92bfd5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240bc840 con 0x7fa9240b7d80 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92bfd5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa924146b30 con 0x7fa9240b8190 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92a572640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240bc430 0x7fa92413ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92a572640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240bc430 0x7fa92413ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54624/0 (socket says 172.21.15.33:54624) 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa92a572640 1 -- 172.21.15.33:0/1146898388 learned_addr learned my addr 172.21.15.33:0/1146898388 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa929d71640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9240b7d80 0x7fa9241d3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.168+0000 7fa929570640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b8190 0x7fa924147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa92a572640 1 -- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b8190 msgr2=0x7fa924147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa92a572640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b8190 0x7fa924147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa92a572640 1 -- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9240b7d80 msgr2=0x7fa9241d3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa92a572640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9240b7d80 0x7fa9241d3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa92a572640 1 -- 172.21.15.33:0/1146898388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9241486d0 con 0x7fa9240bc430 2024-04-25T15:30:46.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa92a572640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240bc430 0x7fa92413ade0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fa91c02ac00 tx=0x7fa91c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa91a7fc640 1 -- 172.21.15.33:0/1146898388 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c03f020 con 0x7fa9240bc430 2024-04-25T15:30:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa91a7fc640 1 -- 172.21.15.33:0/1146898388 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91c037040 con 0x7fa9240bc430 2024-04-25T15:30:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9241e2a50 con 0x7fa9240bc430 2024-04-25T15:30:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa91a7fc640 1 -- 172.21.15.33:0/1146898388 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c036070 con 0x7fa9240bc430 2024-04-25T15:30:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.169+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa924149610 con 0x7fa9240bc430 2024-04-25T15:30:46.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.170+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9241e2c20 con 0x7fa9240bc430 2024-04-25T15:30:46.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.171+0000 7fa91a7fc640 1 -- 172.21.15.33:0/1146898388 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa91c042020 con 0x7fa9240bc430 2024-04-25T15:30:46.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.171+0000 7fa91a7fc640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa9080744e0 0x7fa9080769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.171+0000 7fa91a7fc640 1 -- 172.21.15.33:0/1146898388 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7fa91c0b5ae0 con 0x7fa9240bc430 2024-04-25T15:30:46.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.171+0000 7fa929d71640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa9080744e0 0x7fa9080769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.172+0000 7fa929d71640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa9080744e0 0x7fa9080769f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa924071450 tx=0x7fa914008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.176+0000 7fa91a7fc640 1 -- 172.21.15.33:0/1146898388 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa91c049020 con 0x7fa9240bc430 2024-04-25T15:30:46.361 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.360+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa9240764e0 con 0x7fa9080744e0 2024-04-25T15:30:46.362 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.360+0000 7fa91a7fc640 1 -- 172.21.15.33:0/1146898388 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa9240764e0 con 0x7fa9080744e0 2024-04-25T15:30:46.362 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T15:30:46.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa9080744e0 msgr2=0x7fa9080769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa9080744e0 0x7fa9080769f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa924071450 tx=0x7fa914008040 comp rx=0 tx=0).stop 2024-04-25T15:30:46.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240bc430 msgr2=0x7fa92413ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240bc430 0x7fa92413ade0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fa91c02ac00 tx=0x7fa91c004a40 comp rx=0 tx=0).stop 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 shutdown_connections 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa9080744e0 0x7fa9080769f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9240bc430 0x7fa92413ade0 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9240b8190 0x7fa924147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 --2- 172.21.15.33:0/1146898388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9240b7d80 0x7fa9241d3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 >> 172.21.15.33:0/1146898388 conn(0x7fa92406dd00 msgr2=0x7fa92406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 shutdown_connections 2024-04-25T15:30:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.363+0000 7fa92bfd5640 1 -- 172.21.15.33:0/1146898388 wait complete. 2024-04-25T15:30:46.375 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T15:30:46.375 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:30:46.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.489+0000 7f07babb7640 1 Processor -- start 2024-04-25T15:30:46.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.489+0000 7f07babb7640 1 -- start start 2024-04-25T15:30:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.490+0000 7f07babb7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f07b40b3770 0x7f07b40b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.490+0000 7f07babb7640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b40b3d70 con 0x7f07b40b6ae0 2024-04-25T15:30:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.490+0000 7f07babb7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07b40b4c00 con 0x7f07b40b47f0 2024-04-25T15:30:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.490+0000 7f07babb7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f07b4141e60 con 0x7f07b40b3770 2024-04-25T15:30:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.490+0000 7f07b3fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f07b40b6ae0 0x7f07b4141750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48044/0 (socket says 172.21.15.33:48044) 2024-04-25T15:30:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.490+0000 7f07b3fff640 1 -- 172.21.15.33:0/192240077 learned_addr learned my addr 172.21.15.33:0/192240077 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.491+0000 7f07b8953640 1 --2- 172.21.15.33:0/192240077 >> v2:172.21.15.155:3300/0 conn(0x7f07b40b3770 0x7f07b40b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.491+0000 7f07b37fe640 1 -- 172.21.15.33:0/192240077 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51835253 0 0) 0x7f07a0001110 con 0x7f07b40b6ae0 2024-04-25T15:30:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.491+0000 7f07b37fe640 1 -- 172.21.15.33:0/192240077 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07a4003520 con 0x7f07b40b6ae0 2024-04-25T15:30:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.491+0000 7f07b37fe640 1 -- 172.21.15.33:0/192240077 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1193773189 0 0) 0x7f07a4003520 con 0x7f07b40b6ae0 2024-04-25T15:30:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.491+0000 7f07b8953640 1 -- 172.21.15.33:0/192240077 >> v1:172.21.15.155:6789/0 conn(0x7f07b40b47f0 legacy=0x7f07b4151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.491+0000 7f07b8953640 1 -- 172.21.15.33:0/192240077 >> v1:172.21.15.33:6789/0 conn(0x7f07b40b6ae0 legacy=0x7f07b4141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.491+0000 7f07b8953640 1 -- 172.21.15.33:0/192240077 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b40b41f0 con 0x7f07b40b3770 2024-04-25T15:30:46.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.492+0000 7f07b8953640 1 --2- 172.21.15.33:0/192240077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07b40b3770 0x7f07b40b9050 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f07a80097a0 tx=0x7f07a802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7554f0b7e1bd7dc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.492+0000 7f07b37fe640 1 -- 172.21.15.33:0/192240077 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8037070 con 0x7f07b40b3770 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.492+0000 7f07b37fe640 1 -- 172.21.15.33:0/192240077 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07a802ace0 con 0x7f07b40b3770 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.492+0000 7f07b37fe640 1 -- 172.21.15.33:0/192240077 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a0001840 con 0x7f07b40b3770 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.493+0000 7f07babb7640 1 -- 172.21.15.33:0/192240077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07b40b3770 msgr2=0x7f07b40b9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.493+0000 7f07babb7640 1 --2- 172.21.15.33:0/192240077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07b40b3770 0x7f07b40b9050 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f07a80097a0 tx=0x7f07a802a250 comp rx=0 tx=0).stop 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.493+0000 7f07babb7640 1 -- 172.21.15.33:0/192240077 shutdown_connections 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.493+0000 7f07babb7640 1 --2- 172.21.15.33:0/192240077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07b40b3770 0x7f07b40b9050 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.493+0000 7f07babb7640 1 -- 172.21.15.33:0/192240077 >> 172.21.15.33:0/192240077 conn(0x7f07b4073e90 msgr2=0x7f07b406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.493+0000 7f07babb7640 1 -- 172.21.15.33:0/192240077 shutdown_connections 2024-04-25T15:30:46.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.493+0000 7f07babb7640 1 -- 172.21.15.33:0/192240077 wait complete. 2024-04-25T15:30:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.494+0000 7f07babb7640 1 Processor -- start 2024-04-25T15:30:46.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.494+0000 7f07babb7640 1 -- start start 2024-04-25T15:30:46.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.495+0000 7f07babb7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07b40b3770 0x7f07b41494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.495+0000 7f07babb7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07b40b47f0 0x7f07b413d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.495+0000 7f07babb7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07b40b6ae0 0x7f07b413af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.495+0000 7f07babb7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f07b40b6ef0 con 0x7f07b40b6ae0 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.495+0000 7f07babb7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f07b40b97c0 con 0x7f07b40b3770 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.495+0000 7f07babb7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f07b40b9940 con 0x7f07b40b47f0 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07b40b6ae0 0x7f07b413af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07b40b6ae0 0x7f07b413af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54630/0 (socket says 172.21.15.33:54630) 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 -- 172.21.15.33:0/1754963602 learned_addr learned my addr 172.21.15.33:0/1754963602 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b8953640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07b40b3770 0x7f07b41494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b3fff640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07b40b47f0 0x7f07b413d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 -- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07b40b47f0 msgr2=0x7f07b413d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07b40b47f0 0x7f07b413d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 -- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07b40b3770 msgr2=0x7f07b41494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07b40b3770 0x7f07b41494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 -- 172.21.15.33:0/1754963602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b4147ef0 con 0x7f07b40b6ae0 2024-04-25T15:30:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b9154640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07b40b6ae0 0x7f07b413af10 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00c760 tx=0x7f07ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac003b70 con 0x7f07b40b6ae0 2024-04-25T15:30:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ac003d10 con 0x7f07b40b6ae0 2024-04-25T15:30:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00aa30 con 0x7f07b40b6ae0 2024-04-25T15:30:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b4147410 con 0x7f07b40b6ae0 2024-04-25T15:30:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.496+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b41479d0 con 0x7f07b40b6ae0 2024-04-25T15:30:46.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.497+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07b40764e0 con 0x7f07b40b6ae0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.498+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f07ac00abd0 con 0x7f07b40b6ae0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.499+0000 7f07b17fa640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f07980744e0 0x7f07980769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.499+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7f07ac095a20 con 0x7f07b40b6ae0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.499+0000 7f07b17fa640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f079807c9e0 0x7f079807eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.499+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 --> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f079807f5a0 con 0x7f079807c9e0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.499+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f07ac095eb0 con 0x7f07b40b6ae0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.499+0000 7f07b8953640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f07980744e0 0x7f07980769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.499+0000 7f07b3fff640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f079807c9e0 0x7f079807eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.499+0000 7f07b3fff640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f079807c9e0 0x7f079807eed0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.500+0000 7f07b8953640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f07980744e0 0x7f07980769f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f07a8034000 tx=0x7f07a802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.500+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 <== osd.2 v2:172.21.15.33:6816/1934245664 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f079807f5a0 con 0x7f079807c9e0 2024-04-25T15:30:46.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.513+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 --> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f07b4149340 con 0x7f079807c9e0 2024-04-25T15:30:46.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.513+0000 7f07b17fa640 1 -- 172.21.15.33:0/1754963602 <== osd.2 v2:172.21.15.33:6816/1934245664 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f07b4149340 con 0x7f079807c9e0 2024-04-25T15:30:46.515 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:46.515 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:30:46.515 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f079807c9e0 msgr2=0x7f079807eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.33:6816/1934245664,v1:172.21.15.33:6817/1934245664] conn(0x7f079807c9e0 0x7f079807eed0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f07980744e0 msgr2=0x7f07980769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f07980744e0 0x7f07980769f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f07a8034000 tx=0x7f07a802e000 comp rx=0 tx=0).stop 2024-04-25T15:30:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07b40b6ae0 msgr2=0x7f07b413af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 --2- 172.21.15.33:0/1754963602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07b40b6ae0 0x7f07b413af10 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00c760 tx=0x7f07ac00cc20 comp rx=0 tx=0).stop 2024-04-25T15:30:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07b9154640 1 -- 172.21.15.33:0/1754963602 reap_dead start 2024-04-25T15:30:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 shutdown_connections 2024-04-25T15:30:46.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 >> 172.21.15.33:0/1754963602 conn(0x7f07b4073e90 msgr2=0x7f07b40bc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 shutdown_connections 2024-04-25T15:30:46.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.514+0000 7f07babb7640 1 -- 172.21.15.33:0/1754963602 wait complete. 2024-04-25T15:30:46.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T15:30:46.644 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.643+0000 7fa7cbc4a640 1 Processor -- start 2024-04-25T15:30:46.645 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.643+0000 7fa7cbc4a640 1 -- start start 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.644+0000 7fa7cbc4a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c40bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.644+0000 7fa7cbc4a640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7c40bcf30 0x7fa7c409d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7cbc4a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c4149d40 con 0x7fa7c4149840 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7cbc4a640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c414a820 con 0x7fa7c40bcf30 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7c91e5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c40bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7cbc4a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c414a020 con 0x7fa7c406d230 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7ca1e7640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7c40bcf30 0x7fa7c409d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7c99e6640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa7c4149840 0x7fa7c40be0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.33:44186/0 (socket says 172.21.15.33:44186) 2024-04-25T15:30:46.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7c99e6640 1 -- 172.21.15.33:0/500390297 learned_addr learned my addr 172.21.15.33:0/500390297 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7c89e4640 1 -- 172.21.15.33:0/500390297 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731837229 0 0) 0x7fa7c4149d40 con 0x7fa7c4149840 2024-04-25T15:30:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7c89e4640 1 -- 172.21.15.33:0/500390297 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7b0003520 con 0x7fa7c4149840 2024-04-25T15:30:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7ca1e7640 1 -- 172.21.15.33:0/500390297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 msgr2=0x7fa7c40bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:46.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7ca1e7640 1 --2- 172.21.15.33:0/500390297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c40bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7ca1e7640 1 -- 172.21.15.33:0/500390297 >> v1:172.21.15.155:6789/0 conn(0x7fa7c4149840 legacy=0x7fa7c40be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.645+0000 7fa7ca1e7640 1 -- 172.21.15.33:0/500390297 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c414a300 con 0x7fa7c40bcf30 2024-04-25T15:30:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.646+0000 7fa7ca1e7640 1 --2- 172.21.15.33:0/500390297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c409d3e0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009d90 tx=0x7fa7bc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf9305363c31202 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.646+0000 7fa7c89e4640 1 -- 172.21.15.33:0/500390297 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc031600 con 0x7fa7c40bcf30 2024-04-25T15:30:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.646+0000 7fa7c89e4640 1 -- 172.21.15.33:0/500390297 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc0317a0 con 0x7fa7c40bcf30 2024-04-25T15:30:46.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.646+0000 7fa7c89e4640 1 -- 172.21.15.33:0/500390297 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc031b70 con 0x7fa7c40bcf30 2024-04-25T15:30:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.647+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/500390297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 msgr2=0x7fa7c409d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.647+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/500390297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c409d3e0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009d90 tx=0x7fa7bc02a610 comp rx=0 tx=0).stop 2024-04-25T15:30:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.647+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/500390297 shutdown_connections 2024-04-25T15:30:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.647+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/500390297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c409d3e0 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.647+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/500390297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c40bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.647+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/500390297 >> 172.21.15.33:0/500390297 conn(0x7fa7c40bebf0 msgr2=0x7fa7c40bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.647+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/500390297 shutdown_connections 2024-04-25T15:30:46.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.647+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/500390297 wait complete. 2024-04-25T15:30:46.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.649+0000 7fa7cbc4a640 1 Processor -- start 2024-04-25T15:30:46.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.649+0000 7fa7cbc4a640 1 -- start start 2024-04-25T15:30:46.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7cbc4a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c41e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7cbc4a640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c40a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7cbc4a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7c4149840 0x7fa7c41dff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7cbc4a640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c409daa0 con 0x7fa7c40bcf30 2024-04-25T15:30:46.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7cbc4a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c409d920 con 0x7fa7c4149840 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7cbc4a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c409dc20 con 0x7fa7c406d230 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c91e5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c40a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c91e5640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c40a3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54642/0 (socket says 172.21.15.33:54642) 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c91e5640 1 -- 172.21.15.33:0/116654395 learned_addr learned my addr 172.21.15.33:0/116654395 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c99e6640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c41e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7ca1e7640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7c4149840 0x7fa7c41dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c91e5640 1 -- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 msgr2=0x7fa7c41e3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c91e5640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c41e3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c91e5640 1 -- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7c4149840 msgr2=0x7fa7c41dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c91e5640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7c4149840 0x7fa7c41dff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c91e5640 1 -- 172.21.15.33:0/116654395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c41e3010 con 0x7fa7c40bcf30 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.650+0000 7fa7c99e6640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c41e3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.651+0000 7fa7c91e5640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c40a3a00 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400e840 tx=0x7fa7b400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.651+0000 7fa7ba7fc640 1 -- 172.21.15.33:0/116654395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4017070 con 0x7fa7c40bcf30 2024-04-25T15:30:46.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.651+0000 7fa7ba7fc640 1 -- 172.21.15.33:0/116654395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b400c8e0 con 0x7fa7c40bcf30 2024-04-25T15:30:46.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.651+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c41e32d0 con 0x7fa7c40bcf30 2024-04-25T15:30:46.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.651+0000 7fa7ba7fc640 1 -- 172.21.15.33:0/116654395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400ccb0 con 0x7fa7c40bcf30 2024-04-25T15:30:46.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.651+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c41dfc40 con 0x7fa7c40bcf30 2024-04-25T15:30:46.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.653+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c4140ad0 con 0x7fa7c40bcf30 2024-04-25T15:30:46.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.653+0000 7fa7ba7fc640 1 -- 172.21.15.33:0/116654395 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa7b401a070 con 0x7fa7c40bcf30 2024-04-25T15:30:46.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.653+0000 7fa7ba7fc640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7a80744e0 0x7fa7a80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.653+0000 7fa7ba7fc640 1 -- 172.21.15.33:0/116654395 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7fa7b40953c0 con 0x7fa7c40bcf30 2024-04-25T15:30:46.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.654+0000 7fa7c99e6640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7a80744e0 0x7fa7a80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.654+0000 7fa7c99e6640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7a80744e0 0x7fa7a80769f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007fd0 tx=0x7fa7c0007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.659 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.658+0000 7fa7ba7fc640 1 -- 172.21.15.33:0/116654395 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa7b405f4b0 con 0x7fa7c40bcf30 2024-04-25T15:30:46.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.844+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa7c4141940 con 0x7fa7a80744e0 2024-04-25T15:30:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.845+0000 7fa7ba7fc640 1 -- 172.21.15.33:0/116654395 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa7c4141940 con 0x7fa7a80744e0 2024-04-25T15:30:46.846 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7a80744e0 msgr2=0x7fa7a80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7a80744e0 0x7fa7a80769f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007fd0 tx=0x7fa7c0007dc0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 msgr2=0x7fa7c40a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c40a3a00 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400e840 tx=0x7fa7b400ed00 comp rx=0 tx=0).stop 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 shutdown_connections 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7a80744e0 0x7fa7a80769f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7c4149840 0x7fa7c41dff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7c40bcf30 0x7fa7c40a3a00 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 --2- 172.21.15.33:0/116654395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7c406d230 0x7fa7c41e3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 >> 172.21.15.33:0/116654395 conn(0x7fa7c40bebf0 msgr2=0x7fa7c40b9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 shutdown_connections 2024-04-25T15:30:46.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.847+0000 7fa7cbc4a640 1 -- 172.21.15.33:0/116654395 wait complete. 2024-04-25T15:30:46.859 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T15:30:46.860 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:30:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.973+0000 7fca38b7d640 1 Processor -- start 2024-04-25T15:30:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.973+0000 7fca38b7d640 1 -- start start 2024-04-25T15:30:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca38b7d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca340b6ae0 0x7fca340b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca38b7d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca340b3d70 con 0x7fca340b3770 2024-04-25T15:30:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca38b7d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca340b41f0 con 0x7fca340b9050 2024-04-25T15:30:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca38b7d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fca34141e60 con 0x7fca340b6ae0 2024-04-25T15:30:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3259c640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fca340b3770 0x7fca34141750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48048/0 (socket says 172.21.15.33:48048) 2024-04-25T15:30:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3259c640 1 -- 172.21.15.33:0/2453855593 learned_addr learned my addr 172.21.15.33:0/2453855593 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca32d9d640 1 --2- 172.21.15.33:0/2453855593 >> v2:172.21.15.155:3300/0 conn(0x7fca340b6ae0 0x7fca340b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828231952 0 0) 0x7fca24001110 con 0x7fca340b3770 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c003520 con 0x7fca340b3770 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3750366849 0 0) 0x7fca1c003520 con 0x7fca340b3770 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 >> v2:172.21.15.155:3300/0 conn(0x7fca340b6ae0 msgr2=0x7fca340b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 --2- 172.21.15.33:0/2453855593 >> v2:172.21.15.155:3300/0 conn(0x7fca340b6ae0 0x7fca340b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 >> v1:172.21.15.155:6789/0 conn(0x7fca340b9050 legacy=0x7fca3414ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca340b65c0 con 0x7fca340b3770 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7fca24001840 con 0x7fca340b3770 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 >> v1:172.21.15.33:6789/0 conn(0x7fca340b3770 legacy=0x7fca34141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c0039b0 0x7fca1c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004800 0x7fca1c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca1c0051c0 0x7fca1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca34141e60 con 0x7fca1c0051c0 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c00c150 con 0x7fca1c0039b0 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.975+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c00c350 con 0x7fca1c004800 2024-04-25T15:30:46.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.976+0000 7fca32d9d640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca1c0051c0 0x7fca1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.976+0000 7fca3259c640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c0039b0 0x7fca1c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.976+0000 7fca31d9b640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004800 0x7fca1c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.976+0000 7fca32d9d640 1 -- 172.21.15.33:0/2453855593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004800 msgr2=0x7fca1c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.976+0000 7fca32d9d640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1c004800 0x7fca1c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.976+0000 7fca32d9d640 1 -- 172.21.15.33:0/2453855593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c0039b0 msgr2=0x7fca1c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.976+0000 7fca32d9d640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c0039b0 0x7fca1c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.976+0000 7fca32d9d640 1 -- 172.21.15.33:0/2453855593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c003520 con 0x7fca1c0051c0 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.977+0000 7fca32d9d640 1 -- 172.21.15.33:0/2453855593 reap_dead start 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.977+0000 7fca32d9d640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca1c0051c0 0x7fca1c00b9c0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fca340b7120 tx=0x7fca1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a22f77012bb8b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.977+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c037070 con 0x7fca1c0051c0 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.977+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca2c0325f0 con 0x7fca1c0051c0 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.977+0000 7fca3159a640 1 -- 172.21.15.33:0/2453855593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca2c009c10 con 0x7fca1c0051c0 2024-04-25T15:30:46.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.977+0000 7fca38b7d640 1 -- 172.21.15.33:0/2453855593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca1c0051c0 msgr2=0x7fca1c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.977+0000 7fca38b7d640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca1c0051c0 0x7fca1c00b9c0 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fca340b7120 tx=0x7fca1c005830 comp rx=0 tx=0).stop 2024-04-25T15:30:46.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.978+0000 7fca38b7d640 1 -- 172.21.15.33:0/2453855593 shutdown_connections 2024-04-25T15:30:46.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.978+0000 7fca38b7d640 1 --2- 172.21.15.33:0/2453855593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca1c0051c0 0x7fca1c00b9c0 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.978+0000 7fca38b7d640 1 -- 172.21.15.33:0/2453855593 >> 172.21.15.33:0/2453855593 conn(0x7fca34073e90 msgr2=0x7fca3406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:46.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.978+0000 7fca38b7d640 1 -- 172.21.15.33:0/2453855593 shutdown_connections 2024-04-25T15:30:46.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.978+0000 7fca38b7d640 1 -- 172.21.15.33:0/2453855593 wait complete. 2024-04-25T15:30:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.979+0000 7fca38b7d640 1 Processor -- start 2024-04-25T15:30:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.979+0000 7fca38b7d640 1 -- start start 2024-04-25T15:30:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca38b7d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c0051c0 0x7fca3414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca38b7d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca341e3340 0x7fca3406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca38b7d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406dc10 0x7fca3406e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca38b7d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fca340b4a00 con 0x7fca341e3340 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca38b7d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca340b9460 con 0x7fca1c0051c0 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca38b7d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fca340b4b80 con 0x7fca3406dc10 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca31d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca341e3340 0x7fca3406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca31d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca341e3340 0x7fca3406d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54674/0 (socket says 172.21.15.33:54674) 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.980+0000 7fca31d9b640 1 -- 172.21.15.33:0/1646549793 learned_addr learned my addr 172.21.15.33:0/1646549793 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca3259c640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c0051c0 0x7fca3414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca32d9d640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406dc10 0x7fca3406e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca31d9b640 1 -- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406dc10 msgr2=0x7fca3406e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca31d9b640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406dc10 0x7fca3406e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca31d9b640 1 -- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c0051c0 msgr2=0x7fca3414a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca31d9b640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca1c0051c0 0x7fca3414a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca31d9b640 1 -- 172.21.15.33:0/1646549793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3406ea20 con 0x7fca341e3340 2024-04-25T15:30:46.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca32d9d640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca3406dc10 0x7fca3406e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca31d9b640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca341e3340 0x7fca3406d6d0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fca2800f620 tx=0x7fca2800fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca280052e0 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28018070 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28003810 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca34147c20 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.981+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca341457c0 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.982+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca340bd1a0 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.983+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fca280039b0 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.983+0000 7fca22ffd640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fca140744b0 0x7fca140769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.983+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7fca28095060 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.983+0000 7fca22ffd640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7fca1407c9b0 0x7fca1407eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.983+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 --> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca2800f020 con 0x7fca1407c9b0 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.983+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fca2809c050 con 0x7fca341e3340 2024-04-25T15:30:46.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.984+0000 7fca3259c640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fca140744b0 0x7fca140769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.984+0000 7fca32d9d640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7fca1407c9b0 0x7fca1407eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:46.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.984+0000 7fca32d9d640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7fca1407c9b0 0x7fca1407eea0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.984+0000 7fca3259c640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fca140744b0 0x7fca140769c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca24001050 tx=0x7fca24007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:46.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.985+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 <== osd.3 v2:172.21.15.33:6808/2009635003 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2800f020 con 0x7fca1407c9b0 2024-04-25T15:30:46.999 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.998+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 --> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fca340764e0 con 0x7fca1407c9b0 2024-04-25T15:30:47.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca22ffd640 1 -- 172.21.15.33:0/1646549793 <== osd.3 v2:172.21.15.33:6808/2009635003 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fca340764e0 con 0x7fca1407c9b0 2024-04-25T15:30:47.000 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:47.000 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:30:47.000 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7fca1407c9b0 msgr2=0x7fca1407eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.33:6808/2009635003,v1:172.21.15.33:6809/2009635003] conn(0x7fca1407c9b0 0x7fca1407eea0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fca140744b0 msgr2=0x7fca140769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fca140744b0 0x7fca140769c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca24001050 tx=0x7fca24007aa0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca341e3340 msgr2=0x7fca3406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 --2- 172.21.15.33:0/1646549793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca341e3340 0x7fca3406d6d0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fca2800f620 tx=0x7fca2800fa20 comp rx=0 tx=0).stop 2024-04-25T15:30:47.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca32d9d640 1 -- 172.21.15.33:0/1646549793 reap_dead start 2024-04-25T15:30:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 shutdown_connections 2024-04-25T15:30:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 >> 172.21.15.33:0/1646549793 conn(0x7fca34073e90 msgr2=0x7fca3413e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 shutdown_connections 2024-04-25T15:30:47.002 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:46.999+0000 7fca38b7d640 1 -- 172.21.15.33:0/1646549793 wait complete. 2024-04-25T15:30:47.011 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T15:30:47.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.133+0000 7fe44c442640 1 Processor -- start 2024-04-25T15:30:47.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.133+0000 7fe44c442640 1 -- start start 2024-04-25T15:30:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe44c442640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe4440b19b0 0x7fe444151df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe44c442640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4440b1f00 con 0x7fe4440b15a0 2024-04-25T15:30:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe44c442640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4440718b0 con 0x7fe44406f390 2024-04-25T15:30:47.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe44c442640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fe44406f7a0 con 0x7fe4440b19b0 2024-04-25T15:30:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe4499dd640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe4440b15a0 0x7fe444140350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48050/0 (socket says 172.21.15.33:48050) 2024-04-25T15:30:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe4499dd640 1 -- 172.21.15.33:0/3823136726 learned_addr learned my addr 172.21.15.33:0/3823136726 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe44a9df640 1 --2- 172.21.15.33:0/3823136726 >> v2:172.21.15.33:3300/0 conn(0x7fe4440b19b0 0x7fe444151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe44a9df640 1 -- 172.21.15.33:0/3823136726 >> v1:172.21.15.155:6789/0 conn(0x7fe44406f390 legacy=0x7fe444149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe44a9df640 1 -- 172.21.15.33:0/3823136726 >> v1:172.21.15.33:6789/0 conn(0x7fe4440b15a0 legacy=0x7fe444140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.135+0000 7fe44a9df640 1 -- 172.21.15.33:0/3823136726 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe444071b90 con 0x7fe4440b19b0 2024-04-25T15:30:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.136+0000 7fe44a9df640 1 --2- 172.21.15.33:0/3823136726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440b19b0 0x7fe444151df0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009d90 tx=0x7fe43c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e25f9f4c60a4d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.137+0000 7fe4491dc640 1 -- 172.21.15.33:0/3823136726 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c007740 con 0x7fe4440b19b0 2024-04-25T15:30:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.137+0000 7fe4491dc640 1 -- 172.21.15.33:0/3823136726 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c0078e0 con 0x7fe4440b19b0 2024-04-25T15:30:47.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.137+0000 7fe4491dc640 1 -- 172.21.15.33:0/3823136726 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c007cb0 con 0x7fe4440b19b0 2024-04-25T15:30:47.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.137+0000 7fe44c442640 1 -- 172.21.15.33:0/3823136726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440b19b0 msgr2=0x7fe444151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.137+0000 7fe44c442640 1 --2- 172.21.15.33:0/3823136726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440b19b0 0x7fe444151df0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009d90 tx=0x7fe43c02a660 comp rx=0 tx=0).stop 2024-04-25T15:30:47.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.138+0000 7fe44c442640 1 -- 172.21.15.33:0/3823136726 shutdown_connections 2024-04-25T15:30:47.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.138+0000 7fe44c442640 1 --2- 172.21.15.33:0/3823136726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440b19b0 0x7fe444151df0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.138+0000 7fe44c442640 1 -- 172.21.15.33:0/3823136726 >> 172.21.15.33:0/3823136726 conn(0x7fe44406e5d0 msgr2=0x7fe44406e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.138+0000 7fe44c442640 1 -- 172.21.15.33:0/3823136726 shutdown_connections 2024-04-25T15:30:47.139 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.138+0000 7fe44c442640 1 -- 172.21.15.33:0/3823136726 wait complete. 2024-04-25T15:30:47.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.139+0000 7fe44c442640 1 Processor -- start 2024-04-25T15:30:47.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.139+0000 7fe44c442640 1 -- start start 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44c442640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44406f390 0x7fe44413e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44c442640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4440b15a0 0x7fe4440b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44c442640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4440b19b0 0x7fe4441deaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44c442640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fe444072230 con 0x7fe44406f390 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44c442640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4440720b0 con 0x7fe4440b19b0 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44c442640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe44406fa20 con 0x7fe4440b15a0 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44a1de640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44406f390 0x7fe44413e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44a1de640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44406f390 0x7fe44413e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54692/0 (socket says 172.21.15.33:54692) 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44a1de640 1 -- 172.21.15.33:0/3339786566 learned_addr learned my addr 172.21.15.33:0/3339786566 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:47.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe44a9df640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4440b19b0 0x7fe4441deaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.140+0000 7fe4499dd640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4440b15a0 0x7fe4440b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe44a1de640 1 -- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4440b15a0 msgr2=0x7fe4440b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe44a1de640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4440b15a0 0x7fe4440b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe44a1de640 1 -- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4440b19b0 msgr2=0x7fe4441deaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe44a1de640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4440b19b0 0x7fe4441deaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe44a1de640 1 -- 172.21.15.33:0/3339786566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4440b2140 con 0x7fe44406f390 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe44a1de640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44406f390 0x7fe44413e9c0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fe44000c3c0 tx=0x7fe44000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe43affd640 1 -- 172.21.15.33:0/3339786566 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440017070 con 0x7fe44406f390 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe43affd640 1 -- 172.21.15.33:0/3339786566 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4400052f0 con 0x7fe44406f390 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44413f170 con 0x7fe44406f390 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe43affd640 1 -- 172.21.15.33:0/3339786566 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440003830 con 0x7fe44406f390 2024-04-25T15:30:47.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.141+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4441df540 con 0x7fe44406f390 2024-04-25T15:30:47.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.143+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4441df770 con 0x7fe44406f390 2024-04-25T15:30:47.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.143+0000 7fe43affd640 1 -- 172.21.15.33:0/3339786566 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe44001a070 con 0x7fe44406f390 2024-04-25T15:30:47.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.143+0000 7fe43affd640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fe4280744b0 0x7fe4280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.144+0000 7fe43affd640 1 -- 172.21.15.33:0/3339786566 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5924+0+0 (secure 0 0 0) 0x7fe440094560 con 0x7fe44406f390 2024-04-25T15:30:47.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.144+0000 7fe4499dd640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fe4280744b0 0x7fe4280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.144+0000 7fe4499dd640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fe4280744b0 0x7fe4280769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe4441d5f10 tx=0x7fe434009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.152+0000 7fe43affd640 1 -- 172.21.15.33:0/3339786566 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe4441df770 con 0x7fe44406f390 2024-04-25T15:30:47.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.338+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe44413fde0 con 0x7fe4280744b0 2024-04-25T15:30:47.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.339+0000 7fe43affd640 1 -- 172.21.15.33:0/3339786566 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe4340058b0 con 0x7fe4280744b0 2024-04-25T15:30:47.340 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T15:30:47.344 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.342+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fe4280744b0 msgr2=0x7fe4280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.342+0000 7fe44c442640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fe4280744b0 0x7fe4280769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe4441d5f10 tx=0x7fe434009040 comp rx=0 tx=0).stop 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.342+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44406f390 msgr2=0x7fe44413e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.342+0000 7fe44c442640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44406f390 0x7fe44413e9c0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fe44000c3c0 tx=0x7fe44000c880 comp rx=0 tx=0).stop 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.343+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 shutdown_connections 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.343+0000 7fe44c442640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fe4280744b0 0x7fe4280769c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.343+0000 7fe44c442640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4440b19b0 0x7fe4441deaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.343+0000 7fe44c442640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4440b15a0 0x7fe4440b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.343+0000 7fe44c442640 1 --2- 172.21.15.33:0/3339786566 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44406f390 0x7fe44413e9c0 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.343+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 >> 172.21.15.33:0/3339786566 conn(0x7fe44406e5d0 msgr2=0x7fe444146c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.343+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 shutdown_connections 2024-04-25T15:30:47.345 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.343+0000 7fe44c442640 1 -- 172.21.15.33:0/3339786566 wait complete. 2024-04-25T15:30:47.355 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T15:30:47.356 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:30:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.475+0000 7f4c8cdce640 1 Processor -- start 2024-04-25T15:30:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.475+0000 7f4c8cdce640 1 -- start start 2024-04-25T15:30:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.476+0000 7f4c8cdce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b9050 0x7f4c880b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.476+0000 7f4c8cdce640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c880b47f0 0x7f4c880b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.476+0000 7f4c8cdce640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c880b3d70 con 0x7f4c880b3770 2024-04-25T15:30:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.476+0000 7f4c8cdce640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f4c88141e60 con 0x7f4c880b47f0 2024-04-25T15:30:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.476+0000 7f4c8cdce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c880b9460 con 0x7f4c880b9050 2024-04-25T15:30:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.476+0000 7f4c86d9d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c880b47f0 0x7f4c880b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.476+0000 7f4c8659c640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4c880b3770 0x7f4c88141750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48056/0 (socket says 172.21.15.33:48056) 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.476+0000 7f4c8659c640 1 -- 172.21.15.33:0/4106384760 learned_addr learned my addr 172.21.15.33:0/4106384760 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.477+0000 7f4c85d9b640 1 --2- 172.21.15.33:0/4106384760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b9050 0x7f4c880b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.477+0000 7f4c86d9d640 1 -- 172.21.15.33:0/4106384760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b9050 msgr2=0x7f4c880b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.477+0000 7f4c86d9d640 1 --2- 172.21.15.33:0/4106384760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b9050 0x7f4c880b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.477+0000 7f4c86d9d640 1 -- 172.21.15.33:0/4106384760 >> v1:172.21.15.33:6789/0 conn(0x7f4c880b3770 legacy=0x7f4c88141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.477+0000 7f4c86d9d640 1 -- 172.21.15.33:0/4106384760 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c880b4c00 con 0x7f4c880b47f0 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.477+0000 7f4c8559a640 1 -- 172.21.15.33:0/4106384760 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878776363 0 0) 0x7f4c78001110 con 0x7f4c880b3770 2024-04-25T15:30:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.477+0000 7f4c85d9b640 1 --2- 172.21.15.33:0/4106384760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b9050 0x7f4c880b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:30:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.477+0000 7f4c86d9d640 1 --2- 172.21.15.33:0/4106384760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b47f0 0x7f4c880b97c0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009d90 tx=0x7f4c8002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db53fedce1b63459 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8559a640 1 -- 172.21.15.33:0/4106384760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80007740 con 0x7f4c880b47f0 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8559a640 1 -- 172.21.15.33:0/4106384760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c800078e0 con 0x7f4c880b47f0 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8559a640 1 -- 172.21.15.33:0/4106384760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80007cb0 con 0x7f4c880b47f0 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8cdce640 1 -- 172.21.15.33:0/4106384760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b47f0 msgr2=0x7f4c880b97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8cdce640 1 --2- 172.21.15.33:0/4106384760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b47f0 0x7f4c880b97c0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009d90 tx=0x7f4c8002a6f0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8cdce640 1 -- 172.21.15.33:0/4106384760 shutdown_connections 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8cdce640 1 --2- 172.21.15.33:0/4106384760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b9050 0x7f4c880b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8cdce640 1 --2- 172.21.15.33:0/4106384760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b47f0 0x7f4c880b97c0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8cdce640 1 -- 172.21.15.33:0/4106384760 >> 172.21.15.33:0/4106384760 conn(0x7f4c88073e90 msgr2=0x7f4c8806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8cdce640 1 -- 172.21.15.33:0/4106384760 shutdown_connections 2024-04-25T15:30:47.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.478+0000 7f4c8cdce640 1 -- 172.21.15.33:0/4106384760 wait complete. 2024-04-25T15:30:47.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.480+0000 7f4c8cdce640 1 Processor -- start 2024-04-25T15:30:47.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.480+0000 7f4c8cdce640 1 -- start start 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c8cdce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b3770 0x7f4c880bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c8cdce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c880b47f0 0x7f4c881dd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c8cdce640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b9050 0x7f4c881e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c8cdce640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f4c880b65c0 con 0x7f4c880b9050 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c8cdce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c88151f30 con 0x7f4c880b47f0 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c8cdce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c881520b0 con 0x7f4c880b3770 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c86d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b9050 0x7f4c881e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c86d9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b9050 0x7f4c881e09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54724/0 (socket says 172.21.15.33:54724) 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c86d9d640 1 -- 172.21.15.33:0/3321918921 learned_addr learned my addr 172.21.15.33:0/3321918921 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c8659c640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b3770 0x7f4c880bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.481+0000 7f4c85d9b640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c880b47f0 0x7f4c881dd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c86d9d640 1 -- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b3770 msgr2=0x7f4c880bcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c86d9d640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c880b3770 0x7f4c880bcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c86d9d640 1 -- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c880b47f0 msgr2=0x7f4c881dd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c86d9d640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c880b47f0 0x7f4c881dd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c86d9d640 1 -- 172.21.15.33:0/3321918921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c88145b80 con 0x7f4c880b9050 2024-04-25T15:30:47.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c86d9d640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b9050 0x7f4c881e09c0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009eb0 tx=0x7f4c80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8003f070 con 0x7f4c880b9050 2024-04-25T15:30:47.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c80031bc0 con 0x7f4c880b9050 2024-04-25T15:30:47.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c88145e60 con 0x7f4c880b9050 2024-04-25T15:30:47.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c80044460 con 0x7f4c880b9050 2024-04-25T15:30:47.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.482+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c881ddc10 con 0x7f4c880b9050 2024-04-25T15:30:47.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.483+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c880764e0 con 0x7f4c880b9050 2024-04-25T15:30:47.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.484+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4c80007790 con 0x7f4c880b9050 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.484+0000 7f4c76ffd640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4c680744b0 0x7f4c680769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.484+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7f4c800b7050 con 0x7f4c880b9050 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.485+0000 7f4c76ffd640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f4c6807c9b0 0x7f4c6807eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.485+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 --> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c80042e50 con 0x7f4c6807c9b0 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.485+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4c800b7400 con 0x7f4c880b9050 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.485+0000 7f4c8659c640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4c680744b0 0x7f4c680769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.485+0000 7f4c85d9b640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f4c6807c9b0 0x7f4c6807eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.485+0000 7f4c85d9b640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f4c6807c9b0 0x7f4c6807eea0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.485+0000 7f4c8659c640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4c680744b0 0x7f4c680769c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c78000f60 tx=0x7f4c78007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.486+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 <== osd.4 v2:172.21.15.155:6824/136572947 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c80042e50 con 0x7f4c6807c9b0 2024-04-25T15:30:47.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.499+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 --> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4c88137440 con 0x7f4c6807c9b0 2024-04-25T15:30:47.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c76ffd640 1 -- 172.21.15.33:0/3321918921 <== osd.4 v2:172.21.15.155:6824/136572947 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4c88137440 con 0x7f4c6807c9b0 2024-04-25T15:30:47.501 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:47.501 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:30:47.501 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:47.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f4c6807c9b0 msgr2=0x7f4c6807eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6824/136572947,v1:172.21.15.155:6825/136572947] conn(0x7f4c6807c9b0 0x7f4c6807eea0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4c680744b0 msgr2=0x7f4c680769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f4c680744b0 0x7f4c680769c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c78000f60 tx=0x7f4c78007c00 comp rx=0 tx=0).stop 2024-04-25T15:30:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b9050 msgr2=0x7f4c881e09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 --2- 172.21.15.33:0/3321918921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880b9050 0x7f4c881e09c0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009eb0 tx=0x7f4c80004a40 comp rx=0 tx=0).stop 2024-04-25T15:30:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c86d9d640 1 -- 172.21.15.33:0/3321918921 reap_dead start 2024-04-25T15:30:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 shutdown_connections 2024-04-25T15:30:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 >> 172.21.15.33:0/3321918921 conn(0x7f4c88073e90 msgr2=0x7f4c88075ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 shutdown_connections 2024-04-25T15:30:47.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.500+0000 7f4c8cdce640 1 -- 172.21.15.33:0/3321918921 wait complete. 2024-04-25T15:30:47.512 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T15:30:47.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.622+0000 7fc4b29c7640 1 Processor -- start 2024-04-25T15:30:47.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.623+0000 7fc4b29c7640 1 -- start start 2024-04-25T15:30:47.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4b29c7640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4ac0b3380 0x7fc4ac147c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4b29c7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac148160 0x7fc4ac1410c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4b29c7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc4ac141600 0x7fc4ac14aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4b29c7640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ac070880 con 0x7fc4ac0b3380 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4b29c7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ac147790 con 0x7fc4ac141600 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4b29c7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b3790 con 0x7fc4ac148160 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4abfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4ac0b3380 0x7fc4ac147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4abfff640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4ac0b3380 0x7fc4ac147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54734/0 (socket says 172.21.15.33:54734) 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4abfff640 1 -- 172.21.15.33:0/3586617052 learned_addr learned my addr 172.21.15.33:0/3586617052 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4b0f64640 1 --2- 172.21.15.33:0/3586617052 >> v2:172.21.15.155:3300/0 conn(0x7fc4ac141600 0x7fc4ac14aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4ab7fe640 1 --2- 172.21.15.33:0/3586617052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac148160 0x7fc4ac1410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4abfff640 1 -- 172.21.15.33:0/3586617052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac148160 msgr2=0x7fc4ac1410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4abfff640 1 --2- 172.21.15.33:0/3586617052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac148160 0x7fc4ac1410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4abfff640 1 -- 172.21.15.33:0/3586617052 >> v2:172.21.15.155:3300/0 conn(0x7fc4ac141600 msgr2=0x7fc4ac14aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:47.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4abfff640 1 --2- 172.21.15.33:0/3586617052 >> v2:172.21.15.155:3300/0 conn(0x7fc4ac141600 0x7fc4ac14aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4abfff640 1 -- 172.21.15.33:0/3586617052 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac147480 con 0x7fc4ac0b3380 2024-04-25T15:30:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.624+0000 7fc4ab7fe640 1 --2- 172.21.15.33:0/3586617052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac148160 0x7fc4ac1410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:30:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.625+0000 7fc4abfff640 1 --2- 172.21.15.33:0/3586617052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac0b3380 0x7fc4ac147c20 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0705d0 tx=0x7fc49c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a50f6d649d3d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.625+0000 7fc4aaffd640 1 -- 172.21.15.33:0/3586617052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c037070 con 0x7fc4ac0b3380 2024-04-25T15:30:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.625+0000 7fc4aaffd640 1 -- 172.21.15.33:0/3586617052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49c032440 con 0x7fc4ac0b3380 2024-04-25T15:30:47.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.625+0000 7fc4aaffd640 1 -- 172.21.15.33:0/3586617052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c032810 con 0x7fc4ac0b3380 2024-04-25T15:30:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 -- 172.21.15.33:0/3586617052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac0b3380 msgr2=0x7fc4ac147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/3586617052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac0b3380 0x7fc4ac147c20 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0705d0 tx=0x7fc49c02a140 comp rx=0 tx=0).stop 2024-04-25T15:30:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 -- 172.21.15.33:0/3586617052 shutdown_connections 2024-04-25T15:30:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/3586617052 >> v2:172.21.15.155:3300/0 conn(0x7fc4ac141600 0x7fc4ac14aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/3586617052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac148160 0x7fc4ac1410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/3586617052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac0b3380 0x7fc4ac147c20 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 -- 172.21.15.33:0/3586617052 >> 172.21.15.33:0/3586617052 conn(0x7fc4ac0bcba0 msgr2=0x7fc4ac0bcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 -- 172.21.15.33:0/3586617052 shutdown_connections 2024-04-25T15:30:47.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.626+0000 7fc4b29c7640 1 -- 172.21.15.33:0/3586617052 wait complete. 2024-04-25T15:30:47.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.628+0000 7fc4b29c7640 1 Processor -- start 2024-04-25T15:30:47.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.628+0000 7fc4b29c7640 1 -- start start 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b29c7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac0b3380 0x7fc4ac140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b29c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4ac141600 0x7fc4ac06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b29c7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac148160 0x7fc4ac144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b29c7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b2140 con 0x7fc4ac148160 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b29c7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac0b1fc0 con 0x7fc4ac141600 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b29c7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ac141a10 con 0x7fc4ac0b3380 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b0f64640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac148160 0x7fc4ac144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4abfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac0b3380 0x7fc4ac140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b0f64640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac148160 0x7fc4ac144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54736/0 (socket says 172.21.15.33:54736) 2024-04-25T15:30:47.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b0f64640 1 -- 172.21.15.33:0/261447776 learned_addr learned my addr 172.21.15.33:0/261447776 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4ab7fe640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4ac141600 0x7fc4ac06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4ab7fe640 1 -- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac0b3380 msgr2=0x7fc4ac140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4ab7fe640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac0b3380 0x7fc4ac140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4ab7fe640 1 -- 172.21.15.33:0/261447776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac148160 msgr2=0x7fc4ac144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4ab7fe640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac148160 0x7fc4ac144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4ab7fe640 1 -- 172.21.15.33:0/261447776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac1e2bd0 con 0x7fc4ac141600 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4b0f64640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac148160 0x7fc4ac144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.631+0000 7fc4abfff640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac0b3380 0x7fc4ac140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.632+0000 7fc4ab7fe640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4ac141600 0x7fc4ac06dc50 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0b2790 tx=0x7fc49400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.632+0000 7fc4a8ff9640 1 -- 172.21.15.33:0/261447776 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494004030 con 0x7fc4ac141600 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.632+0000 7fc4a8ff9640 1 -- 172.21.15.33:0/261447776 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4940041d0 con 0x7fc4ac141600 2024-04-25T15:30:47.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.632+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac06e190 con 0x7fc4ac141600 2024-04-25T15:30:47.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.632+0000 7fc4a8ff9640 1 -- 172.21.15.33:0/261447776 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49400b690 con 0x7fc4ac141600 2024-04-25T15:30:47.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.632+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac06f5a0 con 0x7fc4ac141600 2024-04-25T15:30:47.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.633+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ac069ae0 con 0x7fc4ac141600 2024-04-25T15:30:47.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.634+0000 7fc4a8ff9640 1 -- 172.21.15.33:0/261447776 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc49400b830 con 0x7fc4ac141600 2024-04-25T15:30:47.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.634+0000 7fc4a8ff9640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc48c0744b0 0x7fc48c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.635+0000 7fc4a8ff9640 1 -- 172.21.15.33:0/261447776 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7fc494095340 con 0x7fc4ac141600 2024-04-25T15:30:47.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.635+0000 7fc4abfff640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc48c0744b0 0x7fc48c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.635+0000 7fc4abfff640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc48c0744b0 0x7fc48c0769c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc49c034000 tx=0x7fc49c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.640+0000 7fc4a8ff9640 1 -- 172.21.15.33:0/261447776 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc49405f300 con 0x7fc4ac141600 2024-04-25T15:30:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.837+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc4ac0764e0 con 0x7fc48c0744b0 2024-04-25T15:30:47.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.837+0000 7fc4a8ff9640 1 -- 172.21.15.33:0/261447776 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc4ac0764e0 con 0x7fc48c0744b0 2024-04-25T15:30:47.839 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T15:30:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc48c0744b0 msgr2=0x7fc48c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc48c0744b0 0x7fc48c0769c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc49c034000 tx=0x7fc49c02e000 comp rx=0 tx=0).stop 2024-04-25T15:30:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4ac141600 msgr2=0x7fc4ac06dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4ac141600 0x7fc4ac06dc50 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0b2790 tx=0x7fc49400dc60 comp rx=0 tx=0).stop 2024-04-25T15:30:47.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 shutdown_connections 2024-04-25T15:30:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc48c0744b0 0x7fc48c0769c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4ac148160 0x7fc4ac144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4ac141600 0x7fc4ac06dc50 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 --2- 172.21.15.33:0/261447776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc4ac0b3380 0x7fc4ac140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.839+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 >> 172.21.15.33:0/261447776 conn(0x7fc4ac0bcba0 msgr2=0x7fc4ac071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.840+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 shutdown_connections 2024-04-25T15:30:47.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.840+0000 7fc4b29c7640 1 -- 172.21.15.33:0/261447776 wait complete. 2024-04-25T15:30:47.852 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T15:30:47.852 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:30:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.966+0000 7efc7050d640 1 Processor -- start 2024-04-25T15:30:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.966+0000 7efc7050d640 1 -- start start 2024-04-25T15:30:47.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.967+0000 7efc7050d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efc680b89a0 0x7efc6814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.967+0000 7efc7050d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6814d650 con 0x7efc68149b60 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.967+0000 7efc7050d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6814d930 con 0x7efc680b97c0 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.967+0000 7efc7050d640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7efc6814dca0 con 0x7efc680b89a0 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.967+0000 7efc6e2a9640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efc680b89a0 0x7efc6814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.967+0000 7efc6eaaa640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7efc68149b60 0x7efc68149f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48060/0 (socket says 172.21.15.33:48060) 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.967+0000 7efc6e2a9640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efc680b89a0 0x7efc6814cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54748/0 (socket says 172.21.15.33:54748) 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.967+0000 7efc6eaaa640 1 -- 172.21.15.33:0/1118566930 learned_addr learned my addr 172.21.15.33:0/1118566930 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.968+0000 7efc6e2a9640 1 -- 172.21.15.33:0/1118566930 >> v1:172.21.15.155:6789/0 conn(0x7efc680b97c0 legacy=0x7efc68143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.968+0000 7efc6e2a9640 1 -- 172.21.15.33:0/1118566930 >> v1:172.21.15.33:6789/0 conn(0x7efc68149b60 legacy=0x7efc68149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.968+0000 7efc6e2a9640 1 -- 172.21.15.33:0/1118566930 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc680b9bd0 con 0x7efc680b89a0 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.968+0000 7efc6e2a9640 1 --2- 172.21.15.33:0/1118566930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b89a0 0x7efc6814cf80 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7efc640097a0 tx=0x7efc6402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216ec6f2d9d43f30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.968+0000 7efc6d2a7640 1 -- 172.21.15.33:0/1118566930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64037070 con 0x7efc680b89a0 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.968+0000 7efc6d2a7640 1 -- 172.21.15.33:0/1118566930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc64032440 con 0x7efc680b89a0 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.968+0000 7efc6d2a7640 1 -- 172.21.15.33:0/1118566930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc64032810 con 0x7efc680b89a0 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.969+0000 7efc7050d640 1 -- 172.21.15.33:0/1118566930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b89a0 msgr2=0x7efc6814cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.969+0000 7efc7050d640 1 --2- 172.21.15.33:0/1118566930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b89a0 0x7efc6814cf80 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7efc640097a0 tx=0x7efc6402a1a0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.969+0000 7efc7050d640 1 -- 172.21.15.33:0/1118566930 shutdown_connections 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.969+0000 7efc7050d640 1 --2- 172.21.15.33:0/1118566930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b89a0 0x7efc6814cf80 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.969+0000 7efc7050d640 1 -- 172.21.15.33:0/1118566930 >> 172.21.15.33:0/1118566930 conn(0x7efc68074060 msgr2=0x7efc6806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.969+0000 7efc7050d640 1 -- 172.21.15.33:0/1118566930 shutdown_connections 2024-04-25T15:30:47.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.969+0000 7efc7050d640 1 -- 172.21.15.33:0/1118566930 wait complete. 2024-04-25T15:30:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.971+0000 7efc7050d640 1 Processor -- start 2024-04-25T15:30:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.971+0000 7efc7050d640 1 -- start start 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc7050d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc680b89a0 0x7efc6813c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc7050d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b97c0 0x7efc6813ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc7050d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc68149b60 0x7efc68134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc7050d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efc681554a0 con 0x7efc680b97c0 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc7050d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc68155320 con 0x7efc680b89a0 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc7050d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc68155620 con 0x7efc68149b60 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6daa8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b97c0 0x7efc6813ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6daa8640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b97c0 0x7efc6813ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54760/0 (socket says 172.21.15.33:54760) 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6daa8640 1 -- 172.21.15.33:0/488983402 learned_addr learned my addr 172.21.15.33:0/488983402 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6e2a9640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc680b89a0 0x7efc6813c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6eaaa640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc68149b60 0x7efc68134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6daa8640 1 -- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc68149b60 msgr2=0x7efc68134bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6daa8640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc68149b60 0x7efc68134bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6daa8640 1 -- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc680b89a0 msgr2=0x7efc6813c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6daa8640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc680b89a0 0x7efc6813c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.972+0000 7efc6daa8640 1 -- 172.21.15.33:0/488983402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6813d3a0 con 0x7efc680b97c0 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.973+0000 7efc6daa8640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b97c0 0x7efc6813ce60 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c470 tx=0x7efc5800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.973+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc580052d0 con 0x7efc680b97c0 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.973+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc58005490 con 0x7efc680b97c0 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.973+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc680b6320 con 0x7efc680b97c0 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.973+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58007260 con 0x7efc680b97c0 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.973+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc681385b0 con 0x7efc680b97c0 2024-04-25T15:30:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.974+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc680764e0 con 0x7efc680b97c0 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.975+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efc58007400 con 0x7efc680b97c0 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.975+0000 7efc5effd640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efc4c0744b0 0x7efc4c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.976+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7efc58094700 con 0x7efc680b97c0 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.976+0000 7efc6e2a9640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efc4c0744b0 0x7efc4c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.976+0000 7efc5effd640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7efc4c07c9c0 0x7efc4c07eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.976+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 --> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc58011e50 con 0x7efc4c07c9c0 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.976+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7efc5809b050 con 0x7efc680b97c0 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.976+0000 7efc6eaaa640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7efc4c07c9c0 0x7efc4c07eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.976+0000 7efc6e2a9640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efc4c0744b0 0x7efc4c0769c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efc64034000 tx=0x7efc6402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.976+0000 7efc6eaaa640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7efc4c07c9c0 0x7efc4c07eeb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:47.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.977+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 <== osd.5 v2:172.21.15.155:6800/753631458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc58011e50 con 0x7efc4c07c9c0 2024-04-25T15:30:47.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.990+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 --> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efc680bb3b0 con 0x7efc4c07c9c0 2024-04-25T15:30:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc5effd640 1 -- 172.21.15.33:0/488983402 <== osd.5 v2:172.21.15.155:6800/753631458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efc680bb3b0 con 0x7efc4c07c9c0 2024-04-25T15:30:47.992 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:47.992 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:30:47.992 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7efc4c07c9c0 msgr2=0x7efc4c07eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6800/753631458,v1:172.21.15.155:6801/753631458] conn(0x7efc4c07c9c0 0x7efc4c07eeb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efc4c0744b0 msgr2=0x7efc4c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efc4c0744b0 0x7efc4c0769c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efc64034000 tx=0x7efc6402e000 comp rx=0 tx=0).stop 2024-04-25T15:30:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b97c0 msgr2=0x7efc6813ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 --2- 172.21.15.33:0/488983402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc680b97c0 0x7efc6813ce60 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c470 tx=0x7efc5800c930 comp rx=0 tx=0).stop 2024-04-25T15:30:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc6eaaa640 1 -- 172.21.15.33:0/488983402 reap_dead start 2024-04-25T15:30:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 shutdown_connections 2024-04-25T15:30:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 >> 172.21.15.33:0/488983402 conn(0x7efc68074060 msgr2=0x7efc68149f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 shutdown_connections 2024-04-25T15:30:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:47.991+0000 7efc7050d640 1 -- 172.21.15.33:0/488983402 wait complete. 2024-04-25T15:30:48.003 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T15:30:48.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.116+0000 7f65d279e640 1 Processor -- start 2024-04-25T15:30:48.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.116+0000 7f65d279e640 1 -- start start 2024-04-25T15:30:48.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.117+0000 7f65d279e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f65cc06c7a0 0x7f65cc0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.117+0000 7f65d279e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f65cc1436c0 0x7f65cc143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.117+0000 7f65d279e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65cc0b6aa0 con 0x7f65cc14cfd0 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.117+0000 7f65d279e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f65cc0b73a0 con 0x7f65cc1436c0 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.117+0000 7f65d279e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f65cc0b6d50 con 0x7f65cc06c7a0 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.118+0000 7f65cb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f65cc1436c0 0x7f65cc143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.118+0000 7f65cb7fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f65cc1436c0 0x7f65cc143ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54770/0 (socket says 172.21.15.33:54770) 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.118+0000 7f65cb7fe640 1 -- 172.21.15.33:0/1058295658 learned_addr learned my addr 172.21.15.33:0/1058295658 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.118+0000 7f65cbfff640 1 --2- 172.21.15.33:0/1058295658 >> v2:172.21.15.155:3300/0 conn(0x7f65cc06c7a0 0x7f65cc0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.118+0000 7f65cb7fe640 1 -- 172.21.15.33:0/1058295658 >> v2:172.21.15.155:3300/0 conn(0x7f65cc06c7a0 msgr2=0x7f65cc0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.118+0000 7f65cb7fe640 1 --2- 172.21.15.33:0/1058295658 >> v2:172.21.15.155:3300/0 conn(0x7f65cc06c7a0 0x7f65cc0b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.118+0000 7f65cb7fe640 1 -- 172.21.15.33:0/1058295658 >> v1:172.21.15.155:6789/0 conn(0x7f65cc14cfd0 legacy=0x7f65cc14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.118+0000 7f65cb7fe640 1 -- 172.21.15.33:0/1058295658 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc0b7030 con 0x7f65cc1436c0 2024-04-25T15:30:48.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.119+0000 7f65cb7fe640 1 --2- 172.21.15.33:0/1058295658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc1436c0 0x7f65cc143ad0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0713e0 tx=0x7f65c002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd11d86868e96a8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.119+0000 7f65caffd640 1 -- 172.21.15.33:0/1058295658 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0037070 con 0x7f65cc1436c0 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.119+0000 7f65caffd640 1 -- 172.21.15.33:0/1058295658 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0032440 con 0x7f65cc1436c0 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.119+0000 7f65caffd640 1 -- 172.21.15.33:0/1058295658 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0032810 con 0x7f65cc1436c0 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.120+0000 7f65d279e640 1 -- 172.21.15.33:0/1058295658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc1436c0 msgr2=0x7f65cc143ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.120+0000 7f65d279e640 1 --2- 172.21.15.33:0/1058295658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc1436c0 0x7f65cc143ad0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0713e0 tx=0x7f65c002a150 comp rx=0 tx=0).stop 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.120+0000 7f65d279e640 1 -- 172.21.15.33:0/1058295658 shutdown_connections 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.120+0000 7f65d279e640 1 --2- 172.21.15.33:0/1058295658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc1436c0 0x7f65cc143ad0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.120+0000 7f65d279e640 1 --2- 172.21.15.33:0/1058295658 >> v2:172.21.15.155:3300/0 conn(0x7f65cc06c7a0 0x7f65cc0b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.120+0000 7f65d279e640 1 -- 172.21.15.33:0/1058295658 >> 172.21.15.33:0/1058295658 conn(0x7f65cc06d6d0 msgr2=0x7f65cc06dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.120+0000 7f65d279e640 1 -- 172.21.15.33:0/1058295658 shutdown_connections 2024-04-25T15:30:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.120+0000 7f65d279e640 1 -- 172.21.15.33:0/1058295658 wait complete. 2024-04-25T15:30:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.122+0000 7f65d279e640 1 Processor -- start 2024-04-25T15:30:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.122+0000 7f65d279e640 1 -- start start 2024-04-25T15:30:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65d279e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc06c7a0 0x7f65cc0ba500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65d279e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc1436c0 0x7f65cc1df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65d279e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65cc14cfd0 0x7f65cc137000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65d279e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc06d430 con 0x7f65cc06c7a0 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65d279e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc073fd0 con 0x7f65cc1436c0 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65d279e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc153fd0 con 0x7f65cc14cfd0 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc06c7a0 0x7f65cc0ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cbfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc06c7a0 0x7f65cc0ba500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54774/0 (socket says 172.21.15.33:54774) 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cbfff640 1 -- 172.21.15.33:0/1804416255 learned_addr learned my addr 172.21.15.33:0/1804416255 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cb7fe640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc1436c0 0x7f65cc1df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65d0d3b640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65cc14cfd0 0x7f65cc137000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cbfff640 1 -- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65cc14cfd0 msgr2=0x7f65cc137000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cbfff640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65cc14cfd0 0x7f65cc137000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cbfff640 1 -- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc1436c0 msgr2=0x7f65cc1df7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cbfff640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc1436c0 0x7f65cc1df7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cbfff640 1 -- 172.21.15.33:0/1804416255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc1dfd20 con 0x7f65cc06c7a0 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.124+0000 7f65cb7fe640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc1436c0 0x7f65cc1df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.125+0000 7f65cbfff640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc06c7a0 0x7f65cc0ba500 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00e870 tx=0x7f65bc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.125+0000 7f65c8ff9640 1 -- 172.21.15.33:0/1804416255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc017070 con 0x7f65cc06c7a0 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.125+0000 7f65c8ff9640 1 -- 172.21.15.33:0/1804416255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65bc00ee60 con 0x7f65cc06c7a0 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.125+0000 7f65c8ff9640 1 -- 172.21.15.33:0/1804416255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc00cae0 con 0x7f65cc06c7a0 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.125+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65cc13fff0 con 0x7f65cc06c7a0 2024-04-25T15:30:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.125+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc1e32a0 con 0x7f65cc06c7a0 2024-04-25T15:30:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.126+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65cc0764e0 con 0x7f65cc06c7a0 2024-04-25T15:30:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.127+0000 7f65c8ff9640 1 -- 172.21.15.33:0/1804416255 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f65bc01a070 con 0x7f65cc06c7a0 2024-04-25T15:30:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.127+0000 7f65c8ff9640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65b80744b0 0x7f65b80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.127+0000 7f65c8ff9640 1 -- 172.21.15.33:0/1804416255 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7f65bc095660 con 0x7f65cc06c7a0 2024-04-25T15:30:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.127+0000 7f65cb7fe640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65b80744b0 0x7f65b80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.128+0000 7f65cb7fe640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65b80744b0 0x7f65b80769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f65c0034000 tx=0x7f65c002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.136+0000 7f65c8ff9640 1 -- 172.21.15.33:0/1804416255 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65bc05f7e0 con 0x7f65cc06c7a0 2024-04-25T15:30:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.326+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f65cc0bb280 con 0x7f65b80744b0 2024-04-25T15:30:48.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.326+0000 7f65c8ff9640 1 -- 172.21.15.33:0/1804416255 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f65cc0bb280 con 0x7f65b80744b0 2024-04-25T15:30:48.328 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T15:30:48.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65b80744b0 msgr2=0x7f65b80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65b80744b0 0x7f65b80769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f65c0034000 tx=0x7f65c002e000 comp rx=0 tx=0).stop 2024-04-25T15:30:48.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc06c7a0 msgr2=0x7f65cc0ba500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc06c7a0 0x7f65cc0ba500 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00e870 tx=0x7f65bc00ed30 comp rx=0 tx=0).stop 2024-04-25T15:30:48.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 shutdown_connections 2024-04-25T15:30:48.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65b80744b0 0x7f65b80769c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65cc14cfd0 0x7f65cc137000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.330 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65cc1436c0 0x7f65cc1df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 --2- 172.21.15.33:0/1804416255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65cc06c7a0 0x7f65cc0ba500 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 >> 172.21.15.33:0/1804416255 conn(0x7f65cc06d6d0 msgr2=0x7f65cc072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:48.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 shutdown_connections 2024-04-25T15:30:48.331 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.328+0000 7f65d279e640 1 -- 172.21.15.33:0/1804416255 wait complete. 2024-04-25T15:30:48.341 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T15:30:48.341 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:30:48.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.468+0000 7f775732e640 1 Processor -- start 2024-04-25T15:30:48.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.468+0000 7f775732e640 1 -- start start 2024-04-25T15:30:48.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.469+0000 7f775732e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f77500b5240 0x7f7750151230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.469+0000 7f775732e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b6340 0x7f77500b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.469+0000 7f775732e640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f77500b4800 0x7f775014da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.469+0000 7f775732e640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f77500b5860 con 0x7f77500b4800 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.469+0000 7f775732e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f77500b5b40 con 0x7f77500b5240 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.469+0000 7f775732e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77500b5e20 con 0x7f77500b6340 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77558cb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f77500b4800 0x7f775014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77558cb640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f77500b4800 0x7f775014da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54790/0 (socket says 172.21.15.33:54790) 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77558cb640 1 -- 172.21.15.33:0/3055043477 learned_addr learned my addr 172.21.15.33:0/3055043477 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77550ca640 1 --2- 172.21.15.33:0/3055043477 >> v2:172.21.15.155:3300/0 conn(0x7f77500b5240 0x7f7750151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77548c9640 1 --2- 172.21.15.33:0/3055043477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b6340 0x7f77500b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77558cb640 1 -- 172.21.15.33:0/3055043477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b6340 msgr2=0x7f77500b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77558cb640 1 --2- 172.21.15.33:0/3055043477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b6340 0x7f77500b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77558cb640 1 -- 172.21.15.33:0/3055043477 >> v2:172.21.15.155:3300/0 conn(0x7f77500b5240 msgr2=0x7f7750151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77558cb640 1 --2- 172.21.15.33:0/3055043477 >> v2:172.21.15.155:3300/0 conn(0x7f77500b5240 0x7f7750151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.470+0000 7f77558cb640 1 -- 172.21.15.33:0/3055043477 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77500714d0 con 0x7f77500b4800 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.471+0000 7f77558cb640 1 --2- 172.21.15.33:0/3055043477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b4800 0x7f775014da60 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f7750071760 tx=0x7f774802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84965f57c643a956 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.471+0000 7f7747fff640 1 -- 172.21.15.33:0/3055043477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748036070 con 0x7f77500b4800 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.471+0000 7f7747fff640 1 -- 172.21.15.33:0/3055043477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7748031600 con 0x7f77500b4800 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.471+0000 7f7747fff640 1 -- 172.21.15.33:0/3055043477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77480319d0 con 0x7f77500b4800 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 -- 172.21.15.33:0/3055043477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b4800 msgr2=0x7f775014da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 --2- 172.21.15.33:0/3055043477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b4800 0x7f775014da60 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f7750071760 tx=0x7f774802a560 comp rx=0 tx=0).stop 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 -- 172.21.15.33:0/3055043477 shutdown_connections 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 --2- 172.21.15.33:0/3055043477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b4800 0x7f775014da60 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 --2- 172.21.15.33:0/3055043477 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b6340 0x7f77500b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 --2- 172.21.15.33:0/3055043477 >> v2:172.21.15.155:3300/0 conn(0x7f77500b5240 0x7f7750151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 -- 172.21.15.33:0/3055043477 >> 172.21.15.33:0/3055043477 conn(0x7f775006eb70 msgr2=0x7f77500ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 -- 172.21.15.33:0/3055043477 shutdown_connections 2024-04-25T15:30:48.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.472+0000 7f775732e640 1 -- 172.21.15.33:0/3055043477 wait complete. 2024-04-25T15:30:48.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.474+0000 7f775732e640 1 Processor -- start 2024-04-25T15:30:48.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.474+0000 7f775732e640 1 -- start start 2024-04-25T15:30:48.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f775732e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b4800 0x7f77501e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f775732e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77500b5240 0x7f7750142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f775732e640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b6340 0x7f77501456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f775732e640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f7750151f10 con 0x7f77500b6340 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f775732e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7750151d90 con 0x7f77500b5240 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f775732e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77500b6750 con 0x7f77500b4800 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77558cb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b6340 0x7f77501456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77548c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77500b5240 0x7f7750142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77558cb640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b6340 0x7f77501456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54806/0 (socket says 172.21.15.33:54806) 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77558cb640 1 -- 172.21.15.33:0/1532394955 learned_addr learned my addr 172.21.15.33:0/1532394955 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77550ca640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b4800 0x7f77501e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77548c9640 1 -- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b4800 msgr2=0x7f77501e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77548c9640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77500b4800 0x7f77501e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77548c9640 1 -- 172.21.15.33:0/1532394955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b6340 msgr2=0x7f77501456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77548c9640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77500b6340 0x7f77501456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.477 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.475+0000 7f77548c9640 1 -- 172.21.15.33:0/1532394955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77501e6dc0 con 0x7f77500b5240 2024-04-25T15:30:48.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.476+0000 7f77548c9640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77500b5240 0x7f7750142db0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f774000e840 tx=0x7f774000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.476+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7740017070 con 0x7f77500b5240 2024-04-25T15:30:48.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.476+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774000c6d0 con 0x7f77500b5240 2024-04-25T15:30:48.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.476+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77501e39b0 con 0x7f77500b5240 2024-04-25T15:30:48.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.476+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774000caa0 con 0x7f77500b5240 2024-04-25T15:30:48.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.476+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77501432f0 con 0x7f77500b5240 2024-04-25T15:30:48.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.477+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7750146a40 con 0x7f77500b5240 2024-04-25T15:30:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.478+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f774001a070 con 0x7f77500b5240 2024-04-25T15:30:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.478+0000 7f7745ffb640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f77340744b0 0x7f77340769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.478+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7f7740094fa0 con 0x7f77500b5240 2024-04-25T15:30:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.479+0000 7f7745ffb640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f773407c9b0 0x7f773407eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.479+0000 7f77550ca640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f77340744b0 0x7f77340769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.479+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 --> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f773407f570 con 0x7f773407c9b0 2024-04-25T15:30:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.479+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f774009c050 con 0x7f77500b5240 2024-04-25T15:30:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.479+0000 7f77558cb640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f773407c9b0 0x7f773407eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.479+0000 7f77550ca640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f77340744b0 0x7f77340769c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f77500b1c10 tx=0x7f774c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.479+0000 7f77558cb640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f773407c9b0 0x7f773407eea0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.480+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 <== osd.6 v2:172.21.15.155:6808/1724039057 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f773407f570 con 0x7f773407c9b0 2024-04-25T15:30:48.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.496+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 --> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f77500764e0 con 0x7f773407c9b0 2024-04-25T15:30:48.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.496+0000 7f7745ffb640 1 -- 172.21.15.33:0/1532394955 <== osd.6 v2:172.21.15.155:6808/1724039057 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f77500764e0 con 0x7f773407c9b0 2024-04-25T15:30:48.498 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:48.498 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:30:48.498 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f773407c9b0 msgr2=0x7f773407eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6808/1724039057,v1:172.21.15.155:6810/1724039057] conn(0x7f773407c9b0 0x7f773407eea0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f77340744b0 msgr2=0x7f77340769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f77340744b0 0x7f77340769c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f77500b1c10 tx=0x7f774c009190 comp rx=0 tx=0).stop 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77500b5240 msgr2=0x7f7750142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 --2- 172.21.15.33:0/1532394955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77500b5240 0x7f7750142db0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f774000e840 tx=0x7f774000ed00 comp rx=0 tx=0).stop 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f77558cb640 1 -- 172.21.15.33:0/1532394955 reap_dead start 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 shutdown_connections 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 >> 172.21.15.33:0/1532394955 conn(0x7f775006eb70 msgr2=0x7f7750146330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 shutdown_connections 2024-04-25T15:30:48.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.497+0000 7f775732e640 1 -- 172.21.15.33:0/1532394955 wait complete. 2024-04-25T15:30:48.512 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T15:30:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.623+0000 7f91e82e7640 1 Processor -- start 2024-04-25T15:30:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.623+0000 7f91e82e7640 1 -- start start 2024-04-25T15:30:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.624+0000 7f91e82e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0070550 0x7f91e00b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.624+0000 7f91e82e7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f91e00b23e0 0x7f91e0147c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.624+0000 7f91e82e7640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f91e0148190 0x7f91e00b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.624+0000 7f91e82e7640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f91e00b8730 con 0x7f91e0148190 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.624+0000 7f91e82e7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f91e00b8cf0 con 0x7f91e00b23e0 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.624+0000 7f91e82e7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f91e00b3270 con 0x7f91e0070550 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.624+0000 7f91e6884640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f91e0148190 0x7f91e00b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e6884640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f91e0148190 0x7f91e00b7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54818/0 (socket says 172.21.15.33:54818) 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e6884640 1 -- 172.21.15.33:0/2603317676 learned_addr learned my addr 172.21.15.33:0/2603317676 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e5882640 1 --2- 172.21.15.33:0/2603317676 >> v2:172.21.15.155:3300/0 conn(0x7f91e00b23e0 0x7f91e0147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e6083640 1 --2- 172.21.15.33:0/2603317676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0070550 0x7f91e00b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e6884640 1 -- 172.21.15.33:0/2603317676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0070550 msgr2=0x7f91e00b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e6884640 1 --2- 172.21.15.33:0/2603317676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0070550 0x7f91e00b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e6884640 1 -- 172.21.15.33:0/2603317676 >> v2:172.21.15.155:3300/0 conn(0x7f91e00b23e0 msgr2=0x7f91e0147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e6884640 1 --2- 172.21.15.33:0/2603317676 >> v2:172.21.15.155:3300/0 conn(0x7f91e00b23e0 0x7f91e0147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.625+0000 7f91e6884640 1 -- 172.21.15.33:0/2603317676 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e00b3c50 con 0x7f91e0148190 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.626+0000 7f91e6884640 1 --2- 172.21.15.33:0/2603317676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e0148190 0x7f91e00b7510 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f91e00ba670 tx=0x7f91d802a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93bb1b5f73541fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.626+0000 7f91e5081640 1 -- 172.21.15.33:0/2603317676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8036070 con 0x7f91e0148190 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.626+0000 7f91e5081640 1 -- 172.21.15.33:0/2603317676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d8031600 con 0x7f91e0148190 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.626+0000 7f91e5081640 1 -- 172.21.15.33:0/2603317676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80319d0 con 0x7f91e0148190 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 -- 172.21.15.33:0/2603317676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e0148190 msgr2=0x7f91e00b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 --2- 172.21.15.33:0/2603317676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e0148190 0x7f91e00b7510 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f91e00ba670 tx=0x7f91d802a570 comp rx=0 tx=0).stop 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 -- 172.21.15.33:0/2603317676 shutdown_connections 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 --2- 172.21.15.33:0/2603317676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e0148190 0x7f91e00b7510 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 --2- 172.21.15.33:0/2603317676 >> v2:172.21.15.155:3300/0 conn(0x7f91e00b23e0 0x7f91e0147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 --2- 172.21.15.33:0/2603317676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0070550 0x7f91e00b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 -- 172.21.15.33:0/2603317676 >> 172.21.15.33:0/2603317676 conn(0x7f91e0063ad0 msgr2=0x7f91e00bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 -- 172.21.15.33:0/2603317676 shutdown_connections 2024-04-25T15:30:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.627+0000 7f91e82e7640 1 -- 172.21.15.33:0/2603317676 wait complete. 2024-04-25T15:30:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.628+0000 7f91e82e7640 1 Processor -- start 2024-04-25T15:30:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.628+0000 7f91e82e7640 1 -- start start 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e82e7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e0070550 0x7f91e014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e82e7640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e00b23e0 0x7f91e01e06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e82e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0148190 0x7f91e0142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e82e7640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f91e0070960 con 0x7f91e00b23e0 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e82e7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91e00b8980 con 0x7f91e0070550 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e82e7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f91e0071990 con 0x7f91e0148190 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e5882640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e00b23e0 0x7f91e01e06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e5882640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e00b23e0 0x7f91e01e06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54834/0 (socket says 172.21.15.33:54834) 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.629+0000 7f91e5882640 1 -- 172.21.15.33:0/130497996 learned_addr learned my addr 172.21.15.33:0/130497996 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e6083640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e0070550 0x7f91e014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e6884640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0148190 0x7f91e0142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e5882640 1 -- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0148190 msgr2=0x7f91e0142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e5882640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0148190 0x7f91e0142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e5882640 1 -- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e0070550 msgr2=0x7f91e014acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e5882640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e0070550 0x7f91e014acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e5882640 1 -- 172.21.15.33:0/130497996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e01e0c10 con 0x7f91e00b23e0 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e5882640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e00b23e0 0x7f91e01e06d0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00d620 tx=0x7f91dc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91d6ffd640 1 -- 172.21.15.33:0/130497996 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00b620 con 0x7f91e00b23e0 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91d6ffd640 1 -- 172.21.15.33:0/130497996 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91dc019070 con 0x7f91e00b23e0 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e009ee40 con 0x7f91e00b23e0 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91d6ffd640 1 -- 172.21.15.33:0/130497996 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00ba00 con 0x7f91e00b23e0 2024-04-25T15:30:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.630+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e009e720 con 0x7f91e00b23e0 2024-04-25T15:30:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.631+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e00764e0 con 0x7f91e00b23e0 2024-04-25T15:30:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.633+0000 7f91d6ffd640 1 -- 172.21.15.33:0/130497996 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f91dc00bba0 con 0x7f91e00b23e0 2024-04-25T15:30:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.633+0000 7f91d6ffd640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f91c40744e0 0x7f91c40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.633+0000 7f91d6ffd640 1 -- 172.21.15.33:0/130497996 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7f91dc095640 con 0x7f91e00b23e0 2024-04-25T15:30:48.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.633+0000 7f91e6083640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f91c40744e0 0x7f91c40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.634+0000 7f91e6083640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f91c40744e0 0x7f91c40769f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f91d0006fd0 tx=0x7f91d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.638+0000 7f91d6ffd640 1 -- 172.21.15.33:0/130497996 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91dc05fd80 con 0x7f91e00b23e0 2024-04-25T15:30:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.836+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f91e00bad90 con 0x7f91c40744e0 2024-04-25T15:30:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.837+0000 7f91d6ffd640 1 -- 172.21.15.33:0/130497996 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f91e00bad90 con 0x7f91c40744e0 2024-04-25T15:30:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T15:30:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f91c40744e0 msgr2=0x7f91c40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f91c40744e0 0x7f91c40769f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f91d0006fd0 tx=0x7f91d0008040 comp rx=0 tx=0).stop 2024-04-25T15:30:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e00b23e0 msgr2=0x7f91e01e06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e00b23e0 0x7f91e01e06d0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00d620 tx=0x7f91dc00dae0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 shutdown_connections 2024-04-25T15:30:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f91c40744e0 0x7f91c40769f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91e0148190 0x7f91e0142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91e00b23e0 0x7f91e01e06d0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 --2- 172.21.15.33:0/130497996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e0070550 0x7f91e014acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 >> 172.21.15.33:0/130497996 conn(0x7f91e0063ad0 msgr2=0x7f91e00b9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 shutdown_connections 2024-04-25T15:30:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.839+0000 7f91e82e7640 1 -- 172.21.15.33:0/130497996 wait complete. 2024-04-25T15:30:48.851 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T15:30:48.851 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T15:30:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.965+0000 7ff972334640 1 Processor -- start 2024-04-25T15:30:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.965+0000 7ff972334640 1 -- start start 2024-04-25T15:30:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff972334640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8100 0x7ff96c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff972334640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff96c0b8510 0x7ff96c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff972334640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96c0b6e80 con 0x7ff96c0b6860 2024-04-25T15:30:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff972334640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7ff96c0b2990 con 0x7ff96c0b8510 2024-04-25T15:30:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff972334640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c0b7160 con 0x7ff96c0b8100 2024-04-25T15:30:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff9708d1640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff96c0b8510 0x7ff96c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff9708d1640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff96c0b8510 0x7ff96c14d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54836/0 (socket says 172.21.15.33:54836) 2024-04-25T15:30:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff9708d1640 1 -- 172.21.15.33:0/3713467534 learned_addr learned my addr 172.21.15.33:0/3713467534 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff96b7fe640 1 --2- 172.21.15.33:0/3713467534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8100 0x7ff96c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.966+0000 7ff9708d1640 1 -- 172.21.15.33:0/3713467534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8100 msgr2=0x7ff96c14cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.967+0000 7ff9708d1640 1 --2- 172.21.15.33:0/3713467534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8100 0x7ff96c14cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.967+0000 7ff9708d1640 1 -- 172.21.15.33:0/3713467534 >> v1:172.21.15.155:6789/0 conn(0x7ff96c0b6860 legacy=0x7ff96c0b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.967+0000 7ff9708d1640 1 -- 172.21.15.33:0/3713467534 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c0b7440 con 0x7ff96c0b8510 2024-04-25T15:30:48.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff9708d1640 1 --2- 172.21.15.33:0/3713467534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b8510 0x7ff96c14d4c0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7ff964009e50 tx=0x7ff96402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86380795781583b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff96affd640 1 -- 172.21.15.33:0/3713467534 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964036070 con 0x7ff96c0b8510 2024-04-25T15:30:48.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff96affd640 1 -- 172.21.15.33:0/3713467534 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff964031600 con 0x7ff96c0b8510 2024-04-25T15:30:48.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff96affd640 1 -- 172.21.15.33:0/3713467534 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9640319d0 con 0x7ff96c0b8510 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff972334640 1 -- 172.21.15.33:0/3713467534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b8510 msgr2=0x7ff96c14d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff972334640 1 --2- 172.21.15.33:0/3713467534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b8510 0x7ff96c14d4c0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7ff964009e50 tx=0x7ff96402a710 comp rx=0 tx=0).stop 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff972334640 1 -- 172.21.15.33:0/3713467534 shutdown_connections 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff972334640 1 --2- 172.21.15.33:0/3713467534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b8510 0x7ff96c14d4c0 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff972334640 1 --2- 172.21.15.33:0/3713467534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8100 0x7ff96c14cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.968+0000 7ff972334640 1 -- 172.21.15.33:0/3713467534 >> 172.21.15.33:0/3713467534 conn(0x7ff96c0bee40 msgr2=0x7ff96c0bf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.969+0000 7ff972334640 1 -- 172.21.15.33:0/3713467534 shutdown_connections 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.969+0000 7ff972334640 1 -- 172.21.15.33:0/3713467534 wait complete. 2024-04-25T15:30:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.970+0000 7ff972334640 1 Processor -- start 2024-04-25T15:30:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.970+0000 7ff972334640 1 -- start start 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff972334640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b6860 0x7ff96c145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff972334640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c0b8100 0x7ff96c1df890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff972334640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8510 0x7ff96c1e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff972334640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c1540d0 con 0x7ff96c0b6860 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff972334640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c0b7a10 con 0x7ff96c0b8100 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff972334640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c154250 con 0x7ff96c0b8510 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff96bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b6860 0x7ff96c145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff96bfff640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b6860 0x7ff96c145430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54852/0 (socket says 172.21.15.33:54852) 2024-04-25T15:30:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff96bfff640 1 -- 172.21.15.33:0/380549052 learned_addr learned my addr 172.21.15.33:0/380549052 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff96b7fe640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c0b8100 0x7ff96c1df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.971+0000 7ff9708d1640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8510 0x7ff96c1e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff96bfff640 1 -- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8510 msgr2=0x7ff96c1e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff96bfff640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8510 0x7ff96c1e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff96bfff640 1 -- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c0b8100 msgr2=0x7ff96c1df890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff96bfff640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c0b8100 0x7ff96c1df890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff96bfff640 1 -- 172.21.15.33:0/380549052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c1499a0 con 0x7ff96c0b6860 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff96b7fe640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff96c0b8100 0x7ff96c1df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff9708d1640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff96c0b8510 0x7ff96c1e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:30:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff96bfff640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b6860 0x7ff96c145430 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c440 tx=0x7ff95400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540052d0 con 0x7ff96c0b6860 2024-04-25T15:30:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff954005470 con 0x7ff96c0b6860 2024-04-25T15:30:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c146fd0 con 0x7ff96c0b6860 2024-04-25T15:30:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954007260 con 0x7ff96c0b6860 2024-04-25T15:30:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.972+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c1dff40 con 0x7ff96c0b6860 2024-04-25T15:30:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.973+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff96c0764e0 con 0x7ff96c0b6860 2024-04-25T15:30:48.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.974+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff9540074c0 con 0x7ff96c0b6860 2024-04-25T15:30:48.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.974+0000 7ff968ff9640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff94c0744b0 0x7ff94c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.974+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7ff954094830 con 0x7ff96c0b6860 2024-04-25T15:30:48.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.974+0000 7ff96b7fe640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff94c0744b0 0x7ff94c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.974+0000 7ff968ff9640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7ff94c07c9b0 0x7ff94c07eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.974+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 --> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff94c07f570 con 0x7ff94c07c9b0 2024-04-25T15:30:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.974+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff9540992c0 con 0x7ff96c0b6860 2024-04-25T15:30:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.975+0000 7ff9708d1640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7ff94c07c9b0 0x7ff94c07eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.975+0000 7ff96b7fe640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff94c0744b0 0x7ff94c0769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff96c149480 tx=0x7ff95c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.975+0000 7ff9708d1640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7ff94c07c9b0 0x7ff94c07eea0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.976+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 <== osd.7 v2:172.21.15.155:6809/1726313221 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff94c07f570 con 0x7ff94c07c9b0 2024-04-25T15:30:48.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.989+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 --> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff96c1e01a0 con 0x7ff94c07c9b0 2024-04-25T15:30:48.991 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.989+0000 7ff968ff9640 1 -- 172.21.15.33:0/380549052 <== osd.7 v2:172.21.15.155:6809/1726313221 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff96c1e01a0 con 0x7ff94c07c9b0 2024-04-25T15:30:48.991 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-04-25T15:30:48.991 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T15:30:48.991 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-04-25T15:30:48.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7ff94c07c9b0 msgr2=0x7ff94c07eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6809/1726313221,v1:172.21.15.155:6811/1726313221] conn(0x7ff94c07c9b0 0x7ff94c07eea0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:48.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff94c0744b0 msgr2=0x7ff94c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7ff94c0744b0 0x7ff94c0769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff96c149480 tx=0x7ff95c008040 comp rx=0 tx=0).stop 2024-04-25T15:30:48.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b6860 msgr2=0x7ff96c145430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:48.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 --2- 172.21.15.33:0/380549052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c0b6860 0x7ff96c145430 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c440 tx=0x7ff95400c900 comp rx=0 tx=0).stop 2024-04-25T15:30:48.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff9708d1640 1 -- 172.21.15.33:0/380549052 reap_dead start 2024-04-25T15:30:48.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 shutdown_connections 2024-04-25T15:30:48.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 >> 172.21.15.33:0/380549052 conn(0x7ff96c0bee40 msgr2=0x7ff96c0b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:48.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 shutdown_connections 2024-04-25T15:30:48.993 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:48.990+0000 7ff972334640 1 -- 172.21.15.33:0/380549052 wait complete. 2024-04-25T15:30:49.002 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T15:30:49.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.117+0000 7f65d997d640 1 Processor -- start 2024-04-25T15:30:49.118 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.117+0000 7f65d997d640 1 -- start start 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d997d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f65d4073df0 0x7f65d40b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d997d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d4141260 0x7f65d4141670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d997d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d4073630 con 0x7f65d40b2880 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d997d640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f65d4073100 con 0x7f65d4073df0 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d997d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65d4073960 con 0x7f65d4141260 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d2ffd640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f65d4073df0 0x7f65d40b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d27fc640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f65d40b2880 0x7f65d40b7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48076/0 (socket says 172.21.15.33:48076) 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d27fc640 1 -- 172.21.15.33:0/2760562241 learned_addr learned my addr 172.21.15.33:0/2760562241 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d37fe640 1 --2- 172.21.15.33:0/2760562241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d4141260 0x7f65d4141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d2ffd640 1 -- 172.21.15.33:0/2760562241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d4141260 msgr2=0x7f65d4141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d2ffd640 1 --2- 172.21.15.33:0/2760562241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d4141260 0x7f65d4141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d2ffd640 1 -- 172.21.15.33:0/2760562241 >> v1:172.21.15.33:6789/0 conn(0x7f65d40b2880 legacy=0x7f65d40b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.118+0000 7f65d1ffb640 1 -- 172.21.15.33:0/2760562241 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933386654 0 0) 0x7f65d4073630 con 0x7f65d40b2880 2024-04-25T15:30:49.121 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.119+0000 7f65d2ffd640 1 -- 172.21.15.33:0/2760562241 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d4141bb0 con 0x7f65d4073df0 2024-04-25T15:30:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.119+0000 7f65d2ffd640 1 --2- 172.21.15.33:0/2760562241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4073df0 0x7f65d40b51b0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f65d4073ae0 tx=0x7f65c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc2daf3045e5788 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.119+0000 7f65d1ffb640 1 -- 172.21.15.33:0/2760562241 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4037070 con 0x7f65d4073df0 2024-04-25T15:30:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.119+0000 7f65d1ffb640 1 -- 172.21.15.33:0/2760562241 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4032440 con 0x7f65d4073df0 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.119+0000 7f65d1ffb640 1 -- 172.21.15.33:0/2760562241 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4032810 con 0x7f65d4073df0 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.120+0000 7f65d997d640 1 -- 172.21.15.33:0/2760562241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4073df0 msgr2=0x7f65d40b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.120+0000 7f65d997d640 1 --2- 172.21.15.33:0/2760562241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4073df0 0x7f65d40b51b0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f65d4073ae0 tx=0x7f65c402a180 comp rx=0 tx=0).stop 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.120+0000 7f65d997d640 1 -- 172.21.15.33:0/2760562241 shutdown_connections 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.120+0000 7f65d997d640 1 --2- 172.21.15.33:0/2760562241 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d4141260 0x7f65d4141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.120+0000 7f65d997d640 1 --2- 172.21.15.33:0/2760562241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4073df0 0x7f65d40b51b0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.120+0000 7f65d997d640 1 -- 172.21.15.33:0/2760562241 >> 172.21.15.33:0/2760562241 conn(0x7f65d406d6d0 msgr2=0x7f65d406dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.120+0000 7f65d997d640 1 -- 172.21.15.33:0/2760562241 shutdown_connections 2024-04-25T15:30:49.123 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.120+0000 7f65d997d640 1 -- 172.21.15.33:0/2760562241 wait complete. 2024-04-25T15:30:49.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.122+0000 7f65d997d640 1 Processor -- start 2024-04-25T15:30:49.124 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.122+0000 7f65d997d640 1 -- start start 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.123+0000 7f65d997d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d40b2880 0x7f65d4143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.123+0000 7f65d997d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65d4141260 0x7f65d40b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.123+0000 7f65d997d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4137ac0 0x7f65d4137ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.123+0000 7f65d997d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f65d4072e30 con 0x7f65d4137ac0 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.123+0000 7f65d997d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65d4072cb0 con 0x7f65d4141260 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.123+0000 7f65d997d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65d4151dc0 con 0x7f65d40b2880 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.123+0000 7f65d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4137ac0 0x7f65d4137ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.123+0000 7f65d37fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4137ac0 0x7f65d4137ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54874/0 (socket says 172.21.15.33:54874) 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d37fe640 1 -- 172.21.15.33:0/2707999892 learned_addr learned my addr 172.21.15.33:0/2707999892 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:49.126 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d27fc640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65d4141260 0x7f65d40b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d2ffd640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d40b2880 0x7f65d4143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d37fe640 1 -- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d40b2880 msgr2=0x7f65d4143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d37fe640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d40b2880 0x7f65d4143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d37fe640 1 -- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65d4141260 msgr2=0x7f65d40b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d37fe640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65d4141260 0x7f65d40b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d37fe640 1 -- 172.21.15.33:0/2707999892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d40b02e0 con 0x7f65d4137ac0 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d27fc640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65d4141260 0x7f65d40b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d37fe640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4137ac0 0x7f65d4137ed0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009cb0 tx=0x7f65cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65bbfff640 1 -- 172.21.15.33:0/2707999892 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc018020 con 0x7f65d4137ac0 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65bbfff640 1 -- 172.21.15.33:0/2707999892 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65cc014480 con 0x7f65d4137ac0 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d40b4570 con 0x7f65d4137ac0 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65bbfff640 1 -- 172.21.15.33:0/2707999892 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc014870 con 0x7f65d4137ac0 2024-04-25T15:30:49.127 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.124+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d40af130 con 0x7f65d4137ac0 2024-04-25T15:30:49.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.126+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d4144010 con 0x7f65d4137ac0 2024-04-25T15:30:49.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.127+0000 7f65bbfff640 1 -- 172.21.15.33:0/2707999892 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f65cc005d10 con 0x7f65d4137ac0 2024-04-25T15:30:49.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.127+0000 7f65bbfff640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65c00744b0 0x7f65c00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.127+0000 7f65bbfff640 1 -- 172.21.15.33:0/2707999892 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7f65cc095f30 con 0x7f65d4137ac0 2024-04-25T15:30:49.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.128+0000 7f65d2ffd640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65c00744b0 0x7f65c00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.128+0000 7f65d2ffd640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65c00744b0 0x7f65c00769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f65c4034000 tx=0x7f65c402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:49.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.133+0000 7f65bbfff640 1 -- 172.21.15.33:0/2707999892 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65cc022030 con 0x7f65d4137ac0 2024-04-25T15:30:49.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.321+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f65d40764e0 con 0x7f65c00744b0 2024-04-25T15:30:49.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.321+0000 7f65bbfff640 1 -- 172.21.15.33:0/2707999892 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f65d40764e0 con 0x7f65c00744b0 2024-04-25T15:30:49.323 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T15:30:49.325 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65c00744b0 msgr2=0x7f65c00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65c00744b0 0x7f65c00769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f65c4034000 tx=0x7f65c402e000 comp rx=0 tx=0).stop 2024-04-25T15:30:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4137ac0 msgr2=0x7f65d4137ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4137ac0 0x7f65d4137ed0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009cb0 tx=0x7f65cc00c490 comp rx=0 tx=0).stop 2024-04-25T15:30:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 shutdown_connections 2024-04-25T15:30:49.326 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f65c00744b0 0x7f65c00769c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65d4137ac0 0x7f65d4137ed0 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65d4141260 0x7f65d40b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 --2- 172.21.15.33:0/2707999892 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f65d40b2880 0x7f65d4143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 >> 172.21.15.33:0/2707999892 conn(0x7f65d406d6d0 msgr2=0x7f65d4140a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:49.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.323+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 shutdown_connections 2024-04-25T15:30:49.327 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.324+0000 7f65d997d640 1 -- 172.21.15.33:0/2707999892 wait complete. 2024-04-25T15:30:49.337 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:30:49.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.452+0000 7f939ab4d640 1 Processor -- start 2024-04-25T15:30:49.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.452+0000 7f939ab4d640 1 -- start start 2024-04-25T15:30:49.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.453+0000 7f939ab4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9394149840 0x7f939406d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.453+0000 7f939ab4d640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9394149d40 con 0x7f93940be0e0 2024-04-25T15:30:49.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.453+0000 7f939ab4d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f939414a020 con 0x7f93940be4f0 2024-04-25T15:30:49.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.453+0000 7f939ab4d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f939414a820 con 0x7f9394149840 2024-04-25T15:30:49.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f9393fff640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f93940be0e0 0x7f93940bc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48080/0 (socket says 172.21.15.33:48080) 2024-04-25T15:30:49.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f9393fff640 1 -- 172.21.15.33:0/4198639992 learned_addr learned my addr 172.21.15.33:0/4198639992 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:30:49.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f93988e9640 1 --2- 172.21.15.33:0/4198639992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9394149840 0x7f939406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f93937fe640 1 -- 172.21.15.33:0/4198639992 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151707202 0 0) 0x7f9394149d40 con 0x7f93940be0e0 2024-04-25T15:30:49.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f93937fe640 1 -- 172.21.15.33:0/4198639992 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9380003520 con 0x7f93940be0e0 2024-04-25T15:30:49.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f93937fe640 1 -- 172.21.15.33:0/4198639992 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029873153 0 0) 0x7f939414a020 con 0x7f93940be4f0 2024-04-25T15:30:49.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f93937fe640 1 -- 172.21.15.33:0/4198639992 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9394149d40 con 0x7f93940be4f0 2024-04-25T15:30:49.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f93988e9640 1 -- 172.21.15.33:0/4198639992 >> v1:172.21.15.155:6789/0 conn(0x7f93940be4f0 legacy=0x7f939409d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f93988e9640 1 -- 172.21.15.33:0/4198639992 >> v1:172.21.15.33:6789/0 conn(0x7f93940be0e0 legacy=0x7f93940bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.454+0000 7f93988e9640 1 -- 172.21.15.33:0/4198639992 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939414a300 con 0x7f9394149840 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.455+0000 7f93988e9640 1 --2- 172.21.15.33:0/4198639992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9394149840 0x7f939406d230 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f93840097d0 tx=0x7f938402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffa21adcd89eb33c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.455+0000 7f93937fe640 1 -- 172.21.15.33:0/4198639992 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384037070 con 0x7f9394149840 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.455+0000 7f93937fe640 1 -- 172.21.15.33:0/4198639992 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9384032440 con 0x7f9394149840 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.455+0000 7f93937fe640 1 -- 172.21.15.33:0/4198639992 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384032810 con 0x7f9394149840 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.456+0000 7f939ab4d640 1 -- 172.21.15.33:0/4198639992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9394149840 msgr2=0x7f939406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.456+0000 7f939ab4d640 1 --2- 172.21.15.33:0/4198639992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9394149840 0x7f939406d230 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f93840097d0 tx=0x7f938402a200 comp rx=0 tx=0).stop 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.456+0000 7f939ab4d640 1 -- 172.21.15.33:0/4198639992 shutdown_connections 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.456+0000 7f939ab4d640 1 --2- 172.21.15.33:0/4198639992 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9394149840 0x7f939406d230 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.456+0000 7f939ab4d640 1 -- 172.21.15.33:0/4198639992 >> 172.21.15.33:0/4198639992 conn(0x7f93940bebf0 msgr2=0x7f93940bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:49.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.456+0000 7f939ab4d640 1 -- 172.21.15.33:0/4198639992 shutdown_connections 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.456+0000 7f939ab4d640 1 -- 172.21.15.33:0/4198639992 wait complete. 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.457+0000 7f939ab4d640 1 Processor -- start 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.457+0000 7f939ab4d640 1 -- start start 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.458+0000 7f939ab4d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93940be0e0 0x7f93941e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.458+0000 7f939ab4d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93940be4f0 0x7f939414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.458+0000 7f939ab4d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9394149840 0x7f93941e07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.458+0000 7f939ab4d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f939409dc70 con 0x7f9394149840 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.458+0000 7f939ab4d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f939409daf0 con 0x7f93940be4f0 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.458+0000 7f939ab4d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f93941dffd0 con 0x7f93940be0e0 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9394149840 0x7f93941e07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f9393fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93940be4f0 0x7f939414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93988e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93940be0e0 0x7f93941e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9394149840 0x7f93941e07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54886/0 (socket says 172.21.15.33:54886) 2024-04-25T15:30:49.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 -- 172.21.15.33:0/70620920 learned_addr learned my addr 172.21.15.33:0/70620920 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 -- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93940be0e0 msgr2=0x7f93941e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93940be0e0 0x7f93941e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 -- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93940be4f0 msgr2=0x7f939414d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93940be4f0 0x7f939414d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 -- 172.21.15.33:0/70620920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93940b6fb0 con 0x7f9394149840 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93988e9640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93940be0e0 0x7f93941e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93990ea640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9394149840 0x7f93941e07f0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c6e0 tx=0x7f938c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93917fa640 1 -- 172.21.15.33:0/70620920 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c003b70 con 0x7f9394149840 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93917fa640 1 -- 172.21.15.33:0/70620920 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c003d10 con 0x7f9394149840 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f93917fa640 1 -- 172.21.15.33:0/70620920 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c005310 con 0x7f9394149840 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93941e3790 con 0x7f9394149840 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.459+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93941e0170 con 0x7f9394149840 2024-04-25T15:30:49.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.460+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9394141900 con 0x7f9394149840 2024-04-25T15:30:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.461+0000 7f93917fa640 1 -- 172.21.15.33:0/70620920 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f938c0054b0 con 0x7f9394149840 2024-04-25T15:30:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.462+0000 7f93917fa640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f93740744e0 0x7f93740769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:30:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.462+0000 7f93917fa640 1 -- 172.21.15.33:0/70620920 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5924+0+0 (secure 0 0 0) 0x7f938c095a30 con 0x7f9394149840 2024-04-25T15:30:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.462+0000 7f93988e9640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f93740744e0 0x7f93740769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:30:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.463+0000 7f93988e9640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f93740744e0 0x7f93740769f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9384034000 tx=0x7f938402e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:30:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.466+0000 7f93917fa640 1 -- 172.21.15.33:0/70620920 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f938c05fc00 con 0x7f9394149840 2024-04-25T15:30:49.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.649+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93941e03d0 con 0x7f93740744e0 2024-04-25T15:30:49.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.655+0000 7f93917fa640 1 -- 172.21.15.33:0/70620920 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257416 (secure 0 0 0) 0x7f93941e03d0 con 0x7f93740744e0 2024-04-25T15:30:49.659 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:30:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:30:49.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.658+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f93740744e0 msgr2=0x7f93740769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.658+0000 7f939ab4d640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f93740744e0 0x7f93740769f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9384034000 tx=0x7f938402e000 comp rx=0 tx=0).stop 2024-04-25T15:30:49.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.658+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9394149840 msgr2=0x7f93941e07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:30:49.662 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.658+0000 7f939ab4d640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9394149840 0x7f93941e07f0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c6e0 tx=0x7f938c00cba0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.658+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 shutdown_connections 2024-04-25T15:30:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.658+0000 7f939ab4d640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f93740744e0 0x7f93740769f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.659+0000 7f939ab4d640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9394149840 0x7f93941e07f0 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.659+0000 7f939ab4d640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93940be4f0 0x7f939414d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.659+0000 7f939ab4d640 1 --2- 172.21.15.33:0/70620920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93940be0e0 0x7f93941e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:30:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.659+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 >> 172.21.15.33:0/70620920 conn(0x7f93940bebf0 msgr2=0x7f93940bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:30:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.659+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 shutdown_connections 2024-04-25T15:30:49.663 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:30:49.659+0000 7f939ab4d640 1 -- 172.21.15.33:0/70620920 wait complete. 2024-04-25T15:30:49.671 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-04-25T15:30:47.850399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":266401954,"num_objects":1817,"num_object_clones":547,"num_object_copies":3634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1817,"num_whiteouts":539,"num_read":945,"num_read_kb":3515,"num_write":168935,"num_write_kb":625333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311649,"ondisk_log_size":311649,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2899956,"kb_used_data":533616,"kb_used_omap":12,"kb_used_meta":2366259,"kb_avail":752074764,"statfs":{"total":773094113280,"available":770124558336,"internally_reserved":0,"allocated":546422784,"data_stored":534448674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":2423049778},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-165092,"num_objects":-34158,"num_object_clones":-20217,"num_object_copies":-68316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-34158,"num_whiteouts":-13941,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003435"},"pg_stats":[{"pgid":"3.3f","version":"41'3237","reported_seq":2640,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.063605+0000","last_change":"2024-04-25T15:30:44.064226+0000","last_active":"2024-04-25T15:30:44.063605+0000","last_peered":"2024-04-25T15:30:44.063605+0000","last_clean":"2024-04-25T15:30:44.063605+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:30:44.063605+0000","last_undegraded":"2024-04-25T15:30:44.063605+0000","last_fullsized":"2024-04-25T15:30:44.063605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3237,"log_dups_size":0,"ondisk_log_size":3237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:24.611556+0000","scrub_duration":0,"objects_trimmed":632,"snaptrim_duration":13.463749283,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.3e","version":"41'3042","reported_seq":2432,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:41.859299+0000","last_change":"2024-04-25T15:30:41.860972+0000","last_active":"2024-04-25T15:30:41.859299+0000","last_peered":"2024-04-25T15:30:41.859299+0000","last_clean":"2024-04-25T15:30:41.859299+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:30:41.859299+0000","last_undegraded":"2024-04-25T15:30:41.859299+0000","last_fullsized":"2024-04-25T15:30:41.859299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3042,"log_dups_size":0,"ondisk_log_size":3042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:52.269365+0000","scrub_duration":0,"objects_trimmed":636,"snaptrim_duration":11.259556594999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.3d","version":"41'3591","reported_seq":2893,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:43.802453+0000","last_change":"2024-04-25T15:30:43.802499+0000","last_active":"2024-04-25T15:30:43.802453+0000","last_peered":"2024-04-25T15:30:43.802453+0000","last_clean":"2024-04-25T15:30:43.802453+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:30:43.802453+0000","last_undegraded":"2024-04-25T15:30:43.802453+0000","last_fullsized":"2024-04-25T15:30:43.802453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3591,"log_dups_size":0,"ondisk_log_size":3591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:14.294299+0000","scrub_duration":0,"objects_trimmed":691,"snaptrim_duration":13.208408876,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.3c","version":"41'3592","reported_seq":2848,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.795196+0000","last_change":"2024-04-25T15:30:43.795196+0000","last_active":"2024-04-25T15:30:43.795196+0000","last_peered":"2024-04-25T15:30:43.795196+0000","last_clean":"2024-04-25T15:30:43.795196+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:30:43.795196+0000","last_undegraded":"2024-04-25T15:30:43.795196+0000","last_fullsized":"2024-04-25T15:30:43.795196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3592,"log_dups_size":0,"ondisk_log_size":3592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.556786+0000","scrub_duration":0,"objects_trimmed":768,"snaptrim_duration":13.201226914999999,"stat_sum":{"num_bytes":8203,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.3b","version":"41'3626","reported_seq":2876,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.063482+0000","last_change":"2024-04-25T15:30:44.063482+0000","last_active":"2024-04-25T15:30:44.063482+0000","last_peered":"2024-04-25T15:30:44.063482+0000","last_clean":"2024-04-25T15:30:44.063482+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:30:44.063482+0000","last_undegraded":"2024-04-25T15:30:44.063482+0000","last_fullsized":"2024-04-25T15:30:44.063482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:42.248138+0000","scrub_duration":0,"objects_trimmed":724,"snaptrim_duration":13.464445567,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.3a","version":"41'3483","reported_seq":2770,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.701126+0000","last_change":"2024-04-25T15:30:38.703165+0000","last_active":"2024-04-25T15:30:38.701126+0000","last_peered":"2024-04-25T15:30:38.701126+0000","last_clean":"2024-04-25T15:30:38.701126+0000","last_became_active":"2024-04-25T15:21:23.754462+0000","last_became_peered":"2024-04-25T15:21:23.754462+0000","last_unstale":"2024-04-25T15:30:38.701126+0000","last_undegraded":"2024-04-25T15:30:38.701126+0000","last_fullsized":"2024-04-25T15:30:38.701126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3483,"log_dups_size":0,"ondisk_log_size":3483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:36.167106+0000","scrub_duration":0,"objects_trimmed":689,"snaptrim_duration":8.0917395699999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.39","version":"41'3286","reported_seq":2654,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.059500+0000","last_change":"2024-04-25T15:30:44.059500+0000","last_active":"2024-04-25T15:30:44.059500+0000","last_peered":"2024-04-25T15:30:44.059500+0000","last_clean":"2024-04-25T15:30:44.059500+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:30:44.059500+0000","last_undegraded":"2024-04-25T15:30:44.059500+0000","last_fullsized":"2024-04-25T15:30:44.059500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3286,"log_dups_size":0,"ondisk_log_size":3286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:13.096251+0000","scrub_duration":0,"objects_trimmed":681,"snaptrim_duration":13.461782324,"stat_sum":{"num_bytes":4196,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1188,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.38","version":"41'3158","reported_seq":2530,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:41.557031+0000","last_change":"2024-04-25T15:30:41.557031+0000","last_active":"2024-04-25T15:30:41.557031+0000","last_peered":"2024-04-25T15:30:41.557031+0000","last_clean":"2024-04-25T15:30:41.557031+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:30:41.557031+0000","last_undegraded":"2024-04-25T15:30:41.557031+0000","last_fullsized":"2024-04-25T15:30:41.557031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3158,"log_dups_size":0,"ondisk_log_size":3158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:39.840877+0000","scrub_duration":0,"objects_trimmed":675,"snaptrim_duration":10.967992446,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.37","version":"41'3542","reported_seq":2869,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.064959+0000","last_change":"2024-04-25T15:30:44.065626+0000","last_active":"2024-04-25T15:30:44.064959+0000","last_peered":"2024-04-25T15:30:44.064959+0000","last_clean":"2024-04-25T15:30:44.064959+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:30:44.064959+0000","last_undegraded":"2024-04-25T15:30:44.064959+0000","last_fullsized":"2024-04-25T15:30:44.064959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:34.457672+0000","scrub_duration":0,"objects_trimmed":709,"snaptrim_duration":13.464945373000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.36","version":"41'3421","reported_seq":2823,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.882905+0000","last_change":"2024-04-25T15:30:39.883407+0000","last_active":"2024-04-25T15:30:39.882905+0000","last_peered":"2024-04-25T15:30:39.882905+0000","last_clean":"2024-04-25T15:30:39.882905+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:30:39.882905+0000","last_undegraded":"2024-04-25T15:30:39.882905+0000","last_fullsized":"2024-04-25T15:30:39.882905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3421,"log_dups_size":0,"ondisk_log_size":3421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:26.387482+0000","scrub_duration":0,"objects_trimmed":653,"snaptrim_duration":9.2808164089999998,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.35","version":"41'3365","reported_seq":2714,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.881738+0000","last_change":"2024-04-25T15:30:39.882821+0000","last_active":"2024-04-25T15:30:39.881738+0000","last_peered":"2024-04-25T15:30:39.881738+0000","last_clean":"2024-04-25T15:30:39.881738+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:30:39.881738+0000","last_undegraded":"2024-04-25T15:30:39.881738+0000","last_fullsized":"2024-04-25T15:30:39.881738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3365,"log_dups_size":0,"ondisk_log_size":3365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:20.257648+0000","scrub_duration":0,"objects_trimmed":691,"snaptrim_duration":9.2803684680000007,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.34","version":"41'3667","reported_seq":2916,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.675536+0000","last_change":"2024-04-25T15:30:38.675909+0000","last_active":"2024-04-25T15:30:38.675536+0000","last_peered":"2024-04-25T15:30:38.675536+0000","last_clean":"2024-04-25T15:30:38.675536+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:30:38.675536+0000","last_undegraded":"2024-04-25T15:30:38.675536+0000","last_fullsized":"2024-04-25T15:30:38.675536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3667,"log_dups_size":0,"ondisk_log_size":3667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:10.365408+0000","scrub_duration":0,"objects_trimmed":759,"snaptrim_duration":8.0780853560000008,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.33","version":"41'3254","reported_seq":2642,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:43.599462+0000","last_change":"2024-04-25T15:30:43.599580+0000","last_active":"2024-04-25T15:30:43.599462+0000","last_peered":"2024-04-25T15:30:43.599462+0000","last_clean":"2024-04-25T15:30:43.599462+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:30:43.599462+0000","last_undegraded":"2024-04-25T15:30:43.599462+0000","last_fullsized":"2024-04-25T15:30:43.599462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3254,"log_dups_size":0,"ondisk_log_size":3254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:18.828740+0000","scrub_duration":0,"objects_trimmed":647,"snaptrim_duration":13.009390506000001,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1152,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.32","version":"41'3313","reported_seq":2647,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:42.950218+0000","last_change":"2024-04-25T15:30:42.950270+0000","last_active":"2024-04-25T15:30:42.950218+0000","last_peered":"2024-04-25T15:30:42.950218+0000","last_clean":"2024-04-25T15:30:42.950218+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:30:42.950218+0000","last_undegraded":"2024-04-25T15:30:42.950218+0000","last_fullsized":"2024-04-25T15:30:42.950218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3313,"log_dups_size":0,"ondisk_log_size":3313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:44:32.390382+0000","scrub_duration":0,"objects_trimmed":716,"snaptrim_duration":12.356895375000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.31","version":"41'3618","reported_seq":2882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:41.362120+0000","last_change":"2024-04-25T15:30:41.363437+0000","last_active":"2024-04-25T15:30:41.362120+0000","last_peered":"2024-04-25T15:30:41.362120+0000","last_clean":"2024-04-25T15:30:41.362120+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:30:41.362120+0000","last_undegraded":"2024-04-25T15:30:41.362120+0000","last_fullsized":"2024-04-25T15:30:41.362120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3618,"log_dups_size":0,"ondisk_log_size":3618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.286828+0000","scrub_duration":0,"objects_trimmed":722,"snaptrim_duration":10.763348572,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.30","version":"41'3735","reported_seq":3006,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.795263+0000","last_change":"2024-04-25T15:30:43.795621+0000","last_active":"2024-04-25T15:30:43.795263+0000","last_peered":"2024-04-25T15:30:43.795263+0000","last_clean":"2024-04-25T15:30:43.795263+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:30:43.795263+0000","last_undegraded":"2024-04-25T15:30:43.795263+0000","last_fullsized":"2024-04-25T15:30:43.795263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3735,"log_dups_size":0,"ondisk_log_size":3735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:14.294299+0000","scrub_duration":0,"objects_trimmed":699,"snaptrim_duration":13.20232268,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.2f","version":"41'3537","reported_seq":2839,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.796356+0000","last_change":"2024-04-25T15:30:43.797231+0000","last_active":"2024-04-25T15:30:43.796356+0000","last_peered":"2024-04-25T15:30:43.796356+0000","last_clean":"2024-04-25T15:30:43.796356+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:30:43.796356+0000","last_undegraded":"2024-04-25T15:30:43.796356+0000","last_fullsized":"2024-04-25T15:30:43.796356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3537,"log_dups_size":0,"ondisk_log_size":3537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:25.180751+0000","scrub_duration":0,"objects_trimmed":765,"snaptrim_duration":13.203251995,"stat_sum":{"num_bytes":4127,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":1332,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.2e","version":"41'3381","reported_seq":2767,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.293789+0000","last_change":"2024-04-25T15:30:37.294444+0000","last_active":"2024-04-25T15:30:37.293789+0000","last_peered":"2024-04-25T15:30:37.293789+0000","last_clean":"2024-04-25T15:30:37.293789+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:30:37.293789+0000","last_undegraded":"2024-04-25T15:30:37.293789+0000","last_fullsized":"2024-04-25T15:30:37.293789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3381,"log_dups_size":0,"ondisk_log_size":3381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:44:39.283655+0000","scrub_duration":0,"objects_trimmed":607,"snaptrim_duration":6.6868273169999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1074,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.2d","version":"41'3369","reported_seq":2714,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.061114+0000","last_change":"2024-04-25T15:30:44.061823+0000","last_active":"2024-04-25T15:30:44.061114+0000","last_peered":"2024-04-25T15:30:44.061114+0000","last_clean":"2024-04-25T15:30:44.061114+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:30:44.061114+0000","last_undegraded":"2024-04-25T15:30:44.061114+0000","last_fullsized":"2024-04-25T15:30:44.061114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3369,"log_dups_size":0,"ondisk_log_size":3369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:21.008764+0000","scrub_duration":0,"objects_trimmed":675,"snaptrim_duration":13.463314562000001,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.2c","version":"41'3683","reported_seq":3002,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.886254+0000","last_change":"2024-04-25T15:30:39.886798+0000","last_active":"2024-04-25T15:30:39.886254+0000","last_peered":"2024-04-25T15:30:39.886254+0000","last_clean":"2024-04-25T15:30:39.886254+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:30:39.886254+0000","last_undegraded":"2024-04-25T15:30:39.886254+0000","last_fullsized":"2024-04-25T15:30:39.886254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.188818+0000","scrub_duration":0,"objects_trimmed":721,"snaptrim_duration":9.2820153750000003,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.2b","version":"41'3003","reported_seq":2440,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:44.847997+0000","last_change":"2024-04-25T15:30:44.625971+0000","last_active":"2024-04-25T15:30:44.847997+0000","last_peered":"2024-04-25T15:30:44.847997+0000","last_clean":"2024-04-25T15:30:44.847997+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:30:44.847997+0000","last_undegraded":"2024-04-25T15:30:44.847997+0000","last_fullsized":"2024-04-25T15:30:44.847997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3003,"log_dups_size":0,"ondisk_log_size":3003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:25.180751+0000","scrub_duration":0,"objects_trimmed":374,"snaptrim_duration":10.066536516999999,"stat_sum":{"num_bytes":9944,"num_objects":295,"num_object_clones":146,"num_object_copies":590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":295,"num_whiteouts":146,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"3.2a","version":"41'3975","reported_seq":3196,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.834040+0000","last_change":"2024-04-25T15:30:43.834698+0000","last_active":"2024-04-25T15:30:43.834040+0000","last_peered":"2024-04-25T15:30:43.834040+0000","last_clean":"2024-04-25T15:30:43.834040+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:30:43.834040+0000","last_undegraded":"2024-04-25T15:30:43.834040+0000","last_fullsized":"2024-04-25T15:30:43.834040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3975,"log_dups_size":0,"ondisk_log_size":3975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:38.889747+0000","scrub_duration":0,"objects_trimmed":777,"snaptrim_duration":13.240644691,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.29","version":"41'3287","reported_seq":2647,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:44.209356+0000","last_change":"2024-04-25T15:30:44.209407+0000","last_active":"2024-04-25T15:30:44.209356+0000","last_peered":"2024-04-25T15:30:44.209356+0000","last_clean":"2024-04-25T15:30:44.209356+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:30:44.209356+0000","last_undegraded":"2024-04-25T15:30:44.209356+0000","last_fullsized":"2024-04-25T15:30:44.209356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:19.962755+0000","scrub_duration":0,"objects_trimmed":682,"snaptrim_duration":13.620105138,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.28","version":"41'3870","reported_seq":3079,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.793988+0000","last_change":"2024-04-25T15:30:43.794552+0000","last_active":"2024-04-25T15:30:43.793988+0000","last_peered":"2024-04-25T15:30:43.793988+0000","last_clean":"2024-04-25T15:30:43.793988+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:30:43.793988+0000","last_undegraded":"2024-04-25T15:30:43.793988+0000","last_fullsized":"2024-04-25T15:30:43.793988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3870,"log_dups_size":0,"ondisk_log_size":3870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:50.436650+0000","scrub_duration":0,"objects_trimmed":736,"snaptrim_duration":13.201060643,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.27","version":"41'3124","reported_seq":2508,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:41.991954+0000","last_change":"2024-04-25T15:30:41.991996+0000","last_active":"2024-04-25T15:30:41.991954+0000","last_peered":"2024-04-25T15:30:41.991954+0000","last_clean":"2024-04-25T15:30:41.991954+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:30:41.991954+0000","last_undegraded":"2024-04-25T15:30:41.991954+0000","last_fullsized":"2024-04-25T15:30:41.991954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3124,"log_dups_size":0,"ondisk_log_size":3124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:12.255072+0000","scrub_duration":0,"objects_trimmed":639,"snaptrim_duration":11.402777436999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.26","version":"41'3511","reported_seq":2849,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.885489+0000","last_change":"2024-04-25T15:30:39.886183+0000","last_active":"2024-04-25T15:30:39.885489+0000","last_peered":"2024-04-25T15:30:39.885489+0000","last_clean":"2024-04-25T15:30:39.885489+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:30:39.885489+0000","last_undegraded":"2024-04-25T15:30:39.885489+0000","last_fullsized":"2024-04-25T15:30:39.885489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:34.715196+0000","scrub_duration":0,"objects_trimmed":665,"snaptrim_duration":9.2832902970000006,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.25","version":"41'3524","reported_seq":2795,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:41.366095+0000","last_change":"2024-04-25T15:30:41.367628+0000","last_active":"2024-04-25T15:30:41.366095+0000","last_peered":"2024-04-25T15:30:41.366095+0000","last_clean":"2024-04-25T15:30:41.366095+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:30:41.366095+0000","last_undegraded":"2024-04-25T15:30:41.366095+0000","last_fullsized":"2024-04-25T15:30:41.366095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3524,"log_dups_size":0,"ondisk_log_size":3524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:33:34.715196+0000","scrub_duration":0,"objects_trimmed":676,"snaptrim_duration":10.766965595,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.24","version":"41'3298","reported_seq":2623,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:44.283779+0000","last_change":"2024-04-25T15:30:44.283829+0000","last_active":"2024-04-25T15:30:44.283779+0000","last_peered":"2024-04-25T15:30:44.283779+0000","last_clean":"2024-04-25T15:30:44.283779+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:30:44.283779+0000","last_undegraded":"2024-04-25T15:30:44.283779+0000","last_fullsized":"2024-04-25T15:30:44.283779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3298,"log_dups_size":0,"ondisk_log_size":3298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:42.101503+0000","scrub_duration":0,"objects_trimmed":656,"snaptrim_duration":13.694283608999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.23","version":"41'3448","reported_seq":2751,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:44.490170+0000","last_change":"2024-04-25T15:30:44.490236+0000","last_active":"2024-04-25T15:30:44.490170+0000","last_peered":"2024-04-25T15:30:44.490170+0000","last_clean":"2024-04-25T15:30:44.490170+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:30:44.490170+0000","last_undegraded":"2024-04-25T15:30:44.490170+0000","last_fullsized":"2024-04-25T15:30:44.490170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":0,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:08.750880+0000","scrub_duration":0,"objects_trimmed":729,"snaptrim_duration":13.896343272999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"3.22","version":"41'3138","reported_seq":2509,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.299277+0000","last_change":"2024-04-25T15:30:37.300211+0000","last_active":"2024-04-25T15:30:37.299277+0000","last_peered":"2024-04-25T15:30:37.299277+0000","last_clean":"2024-04-25T15:30:37.299277+0000","last_became_active":"2024-04-25T15:21:23.859850+0000","last_became_peered":"2024-04-25T15:21:23.859850+0000","last_unstale":"2024-04-25T15:30:37.299277+0000","last_undegraded":"2024-04-25T15:30:37.299277+0000","last_fullsized":"2024-04-25T15:30:37.299277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3138,"log_dups_size":0,"ondisk_log_size":3138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:29:49.950843+0000","scrub_duration":0,"objects_trimmed":606,"snaptrim_duration":6.6890380110000001,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.21","version":"41'4292","reported_seq":3407,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:37.296102+0000","last_change":"2024-04-25T15:30:37.296764+0000","last_active":"2024-04-25T15:30:37.296102+0000","last_peered":"2024-04-25T15:30:37.296102+0000","last_clean":"2024-04-25T15:30:37.296102+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:30:37.296102+0000","last_undegraded":"2024-04-25T15:30:37.296102+0000","last_fullsized":"2024-04-25T15:30:37.296102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":4292,"log_dups_size":0,"ondisk_log_size":4292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:20.083988+0000","scrub_duration":0,"objects_trimmed":828,"snaptrim_duration":6.6887649839999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1392,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.20","version":"41'3875","reported_seq":3107,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.884126+0000","last_change":"2024-04-25T15:30:39.885338+0000","last_active":"2024-04-25T15:30:39.884126+0000","last_peered":"2024-04-25T15:30:39.884126+0000","last_clean":"2024-04-25T15:30:39.884126+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:30:39.884126+0000","last_undegraded":"2024-04-25T15:30:39.884126+0000","last_fullsized":"2024-04-25T15:30:39.884126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3875,"log_dups_size":0,"ondisk_log_size":3875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:27.011814+0000","scrub_duration":0,"objects_trimmed":743,"snaptrim_duration":9.2833888390000006,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.1a","version":"41'3757","reported_seq":2999,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676214+0000","last_change":"2024-04-25T15:30:38.676214+0000","last_active":"2024-04-25T15:30:38.676214+0000","last_peered":"2024-04-25T15:30:38.676214+0000","last_clean":"2024-04-25T15:30:38.676214+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:30:38.676214+0000","last_undegraded":"2024-04-25T15:30:38.676214+0000","last_fullsized":"2024-04-25T15:30:38.676214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:32.184227+0000","scrub_duration":0,"objects_trimmed":718,"snaptrim_duration":8.0786759789999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.1b","version":"40'3208","reported_seq":3268,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.590030+0000","last_change":"2024-04-25T15:20:41.411834+0000","last_active":"2024-04-25T15:30:30.590030+0000","last_peered":"2024-04-25T15:30:30.590030+0000","last_clean":"2024-04-25T15:30:30.590030+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:30:30.590030+0000","last_undegraded":"2024-04-25T15:30:30.590030+0000","last_fullsized":"2024-04-25T15:30:30.590030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":3284,"num_write_kb":9502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"41'3207","reported_seq":2581,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:44.853080+0000","last_change":"2024-04-25T15:30:44.490278+0000","last_active":"2024-04-25T15:30:44.853080+0000","last_peered":"2024-04-25T15:30:44.853080+0000","last_clean":"2024-04-25T15:30:44.853080+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:30:44.853080+0000","last_undegraded":"2024-04-25T15:30:44.853080+0000","last_fullsized":"2024-04-25T15:30:44.853080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3207,"log_dups_size":0,"ondisk_log_size":3207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:50.436650+0000","scrub_duration":0,"objects_trimmed":489,"snaptrim_duration":9.2035530340000005,"stat_sum":{"num_bytes":1548,"num_objects":259,"num_object_clones":129,"num_object_copies":518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":129,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.1a","version":"40'6006","reported_seq":6066,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602440+0000","last_change":"2024-04-25T15:20:41.401581+0000","last_active":"2024-04-25T15:30:30.602440+0000","last_peered":"2024-04-25T15:30:30.602440+0000","last_clean":"2024-04-25T15:30:30.602440+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:30:30.602440+0000","last_undegraded":"2024-04-25T15:30:30.602440+0000","last_fullsized":"2024-04-25T15:30:30.602440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6006,"log_dups_size":0,"ondisk_log_size":6006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":6066,"num_write_kb":31066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"40'881","reported_seq":941,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589144+0000","last_change":"2024-04-25T15:20:41.404692+0000","last_active":"2024-04-25T15:30:30.589144+0000","last_peered":"2024-04-25T15:30:30.589144+0000","last_clean":"2024-04-25T15:30:30.589144+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:30:30.589144+0000","last_undegraded":"2024-04-25T15:30:30.589144+0000","last_fullsized":"2024-04-25T15:30:30.589144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":944,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"41'3836","reported_seq":3037,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:42.869486+0000","last_change":"2024-04-25T15:30:42.869535+0000","last_active":"2024-04-25T15:30:42.869486+0000","last_peered":"2024-04-25T15:30:42.869486+0000","last_clean":"2024-04-25T15:30:42.869486+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:30:42.869486+0000","last_undegraded":"2024-04-25T15:30:42.869486+0000","last_fullsized":"2024-04-25T15:30:42.869486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3836,"log_dups_size":0,"ondisk_log_size":3836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:35.107011+0000","scrub_duration":0,"objects_trimmed":818,"snaptrim_duration":12.280404586,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1372,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.18","version":"40'3115","reported_seq":3175,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593773+0000","last_change":"2024-04-25T15:20:41.406208+0000","last_active":"2024-04-25T15:30:30.593773+0000","last_peered":"2024-04-25T15:30:30.593773+0000","last_clean":"2024-04-25T15:30:30.593773+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:30:30.593773+0000","last_undegraded":"2024-04-25T15:30:30.593773+0000","last_fullsized":"2024-04-25T15:30:30.593773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3115,"log_dups_size":0,"ondisk_log_size":3115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3188,"num_write_kb":38703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"41'3651","reported_seq":2956,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:41.360709+0000","last_change":"2024-04-25T15:30:41.362056+0000","last_active":"2024-04-25T15:30:41.360709+0000","last_peered":"2024-04-25T15:30:41.360709+0000","last_clean":"2024-04-25T15:30:41.360709+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:30:41.360709+0000","last_undegraded":"2024-04-25T15:30:41.360709+0000","last_fullsized":"2024-04-25T15:30:41.360709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3651,"log_dups_size":0,"ondisk_log_size":3651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:27.011814+0000","scrub_duration":0,"objects_trimmed":658,"snaptrim_duration":10.762374617999999,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.17","version":"40'1109","reported_seq":1169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602496+0000","last_change":"2024-04-25T15:20:41.406067+0000","last_active":"2024-04-25T15:30:30.602496+0000","last_peered":"2024-04-25T15:30:30.602496+0000","last_clean":"2024-04-25T15:30:30.602496+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:30:30.602496+0000","last_undegraded":"2024-04-25T15:30:30.602496+0000","last_fullsized":"2024-04-25T15:30:30.602496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1182,"num_write_kb":13307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"41'3344","reported_seq":2712,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:41.364816+0000","last_change":"2024-04-25T15:30:41.366150+0000","last_active":"2024-04-25T15:30:41.364816+0000","last_peered":"2024-04-25T15:30:41.364816+0000","last_clean":"2024-04-25T15:30:41.364816+0000","last_became_active":"2024-04-25T15:21:23.536519+0000","last_became_peered":"2024-04-25T15:21:23.536519+0000","last_unstale":"2024-04-25T15:30:41.364816+0000","last_undegraded":"2024-04-25T15:30:41.364816+0000","last_fullsized":"2024-04-25T15:30:41.364816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:57:17.188818+0000","scrub_duration":0,"objects_trimmed":659,"snaptrim_duration":10.764864054,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.16","version":"40'1813","reported_seq":1873,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593511+0000","last_change":"2024-04-25T15:20:41.410325+0000","last_active":"2024-04-25T15:30:30.593511+0000","last_peered":"2024-04-25T15:30:30.593511+0000","last_clean":"2024-04-25T15:30:30.593511+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:30:30.593511+0000","last_undegraded":"2024-04-25T15:30:30.593511+0000","last_fullsized":"2024-04-25T15:30:30.593511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1874,"num_write_kb":25731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"41'3552","reported_seq":2839,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:42.313884+0000","last_change":"2024-04-25T15:30:42.313929+0000","last_active":"2024-04-25T15:30:42.313884+0000","last_peered":"2024-04-25T15:30:42.313884+0000","last_clean":"2024-04-25T15:30:42.313884+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:30:42.313884+0000","last_undegraded":"2024-04-25T15:30:42.313884+0000","last_fullsized":"2024-04-25T15:30:42.313884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:46:23.746310+0000","scrub_duration":0,"objects_trimmed":712,"snaptrim_duration":11.72106834,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1199,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.15","version":"40'3249","reported_seq":3308,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600801+0000","last_change":"2024-04-25T15:20:41.415893+0000","last_active":"2024-04-25T15:30:30.600801+0000","last_peered":"2024-04-25T15:30:30.600801+0000","last_clean":"2024-04-25T15:30:30.600801+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:30:30.600801+0000","last_undegraded":"2024-04-25T15:30:30.600801+0000","last_fullsized":"2024-04-25T15:30:30.600801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3249,"log_dups_size":0,"ondisk_log_size":3249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3319,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'3965","reported_seq":3179,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676280+0000","last_change":"2024-04-25T15:30:38.676764+0000","last_active":"2024-04-25T15:30:38.676280+0000","last_peered":"2024-04-25T15:30:38.676280+0000","last_clean":"2024-04-25T15:30:38.676280+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:30:38.676280+0000","last_undegraded":"2024-04-25T15:30:38.676280+0000","last_fullsized":"2024-04-25T15:30:38.676280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3965,"log_dups_size":0,"ondisk_log_size":3965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:50.458209+0000","scrub_duration":0,"objects_trimmed":757,"snaptrim_duration":8.0786606909999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.14","version":"41'5275","reported_seq":5335,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.604978+0000","last_change":"2024-04-25T15:20:41.406750+0000","last_active":"2024-04-25T15:30:30.604978+0000","last_peered":"2024-04-25T15:30:30.604978+0000","last_clean":"2024-04-25T15:30:30.604978+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:30:30.604978+0000","last_undegraded":"2024-04-25T15:30:30.604978+0000","last_fullsized":"2024-04-25T15:30:30.604978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":5275,"log_dups_size":0,"ondisk_log_size":5275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":5332,"num_write_kb":30677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"41'3636","reported_seq":2906,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.057781+0000","last_change":"2024-04-25T15:30:44.058444+0000","last_active":"2024-04-25T15:30:44.057781+0000","last_peered":"2024-04-25T15:30:44.057781+0000","last_clean":"2024-04-25T15:30:44.057781+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:30:44.057781+0000","last_undegraded":"2024-04-25T15:30:44.057781+0000","last_fullsized":"2024-04-25T15:30:44.057781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:40.123031+0000","scrub_duration":0,"objects_trimmed":714,"snaptrim_duration":13.460606116999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.13","version":"40'2601","reported_seq":2661,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.594170+0000","last_change":"2024-04-25T15:20:41.401705+0000","last_active":"2024-04-25T15:30:30.594170+0000","last_peered":"2024-04-25T15:30:30.594170+0000","last_clean":"2024-04-25T15:30:30.594170+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:30:30.594170+0000","last_undegraded":"2024-04-25T15:30:30.594170+0000","last_fullsized":"2024-04-25T15:30:30.594170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2601,"log_dups_size":0,"ondisk_log_size":2601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:15.095846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":2688,"num_write_kb":17973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"41'3291","reported_seq":2629,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:43.570617+0000","last_change":"2024-04-25T15:30:43.570665+0000","last_active":"2024-04-25T15:30:43.570617+0000","last_peered":"2024-04-25T15:30:43.570617+0000","last_clean":"2024-04-25T15:30:43.570617+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:30:43.570617+0000","last_undegraded":"2024-04-25T15:30:43.570617+0000","last_fullsized":"2024-04-25T15:30:43.570617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3291,"log_dups_size":0,"ondisk_log_size":3291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:59:57.104366+0000","scrub_duration":0,"objects_trimmed":688,"snaptrim_duration":12.97705107,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1228,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.12","version":"40'111","reported_seq":171,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593646+0000","last_change":"2024-04-25T15:20:41.409212+0000","last_active":"2024-04-25T15:30:30.593646+0000","last_peered":"2024-04-25T15:30:30.593646+0000","last_clean":"2024-04-25T15:30:30.593646+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:30:30.593646+0000","last_undegraded":"2024-04-25T15:30:30.593646+0000","last_fullsized":"2024-04-25T15:30:30.593646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":196,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"41'4119","reported_seq":3342,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.061888+0000","last_change":"2024-04-25T15:30:44.062591+0000","last_active":"2024-04-25T15:30:44.061888+0000","last_peered":"2024-04-25T15:30:44.061888+0000","last_clean":"2024-04-25T15:30:44.061888+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:30:44.061888+0000","last_undegraded":"2024-04-25T15:30:44.061888+0000","last_fullsized":"2024-04-25T15:30:44.061888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:43.450201+0000","scrub_duration":0,"objects_trimmed":756,"snaptrim_duration":13.463338272,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1302,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.11","version":"40'1074","reported_seq":1134,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602130+0000","last_change":"2024-04-25T15:20:41.402015+0000","last_active":"2024-04-25T15:30:30.602130+0000","last_peered":"2024-04-25T15:30:30.602130+0000","last_clean":"2024-04-25T15:30:30.602130+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:30:30.602130+0000","last_undegraded":"2024-04-25T15:30:30.602130+0000","last_fullsized":"2024-04-25T15:30:30.602130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1074,"log_dups_size":0,"ondisk_log_size":1074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1158,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"41'3501","reported_seq":2786,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:40.536845+0000","last_change":"2024-04-25T15:30:40.537911+0000","last_active":"2024-04-25T15:30:40.536845+0000","last_peered":"2024-04-25T15:30:40.536845+0000","last_clean":"2024-04-25T15:30:40.536845+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:30:40.536845+0000","last_undegraded":"2024-04-25T15:30:40.536845+0000","last_fullsized":"2024-04-25T15:30:40.536845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3501,"log_dups_size":0,"ondisk_log_size":3501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:52.269365+0000","scrub_duration":0,"objects_trimmed":671,"snaptrim_duration":9.9325539109999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.10","version":"40'1015","reported_seq":1074,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.607771+0000","last_change":"2024-04-25T15:20:41.408427+0000","last_active":"2024-04-25T15:30:30.607771+0000","last_peered":"2024-04-25T15:30:30.607771+0000","last_clean":"2024-04-25T15:30:30.607771+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:30:30.607771+0000","last_undegraded":"2024-04-25T15:30:30.607771+0000","last_fullsized":"2024-04-25T15:30:30.607771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1107,"num_write_kb":8933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"41'3476","reported_seq":2769,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.060241+0000","last_change":"2024-04-25T15:30:44.061034+0000","last_active":"2024-04-25T15:30:44.060241+0000","last_peered":"2024-04-25T15:30:44.060241+0000","last_clean":"2024-04-25T15:30:44.060241+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:30:44.060241+0000","last_undegraded":"2024-04-25T15:30:44.060241+0000","last_fullsized":"2024-04-25T15:30:44.060241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3476,"log_dups_size":0,"ondisk_log_size":3476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:38.071652+0000","scrub_duration":0,"objects_trimmed":708,"snaptrim_duration":13.462787312,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.f","version":"40'1305","reported_seq":1365,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.597526+0000","last_change":"2024-04-25T15:20:41.405515+0000","last_active":"2024-04-25T15:30:30.597526+0000","last_peered":"2024-04-25T15:30:30.597526+0000","last_clean":"2024-04-25T15:30:30.597526+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:30:30.597526+0000","last_undegraded":"2024-04-25T15:30:30.597526+0000","last_fullsized":"2024-04-25T15:30:30.597526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1305,"log_dups_size":0,"ondisk_log_size":1305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":1351,"num_write_kb":8728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"41'3637","reported_seq":2873,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.064284+0000","last_change":"2024-04-25T15:30:44.064883+0000","last_active":"2024-04-25T15:30:44.064284+0000","last_peered":"2024-04-25T15:30:44.064284+0000","last_clean":"2024-04-25T15:30:44.064284+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:30:44.064284+0000","last_undegraded":"2024-04-25T15:30:44.064284+0000","last_fullsized":"2024-04-25T15:30:44.064284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3637,"log_dups_size":0,"ondisk_log_size":3637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:59:57.855461+0000","scrub_duration":0,"objects_trimmed":736,"snaptrim_duration":13.465097034999999,"stat_sum":{"num_bytes":14,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.e","version":"40'2474","reported_seq":2533,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.607786+0000","last_change":"2024-04-25T15:20:41.406806+0000","last_active":"2024-04-25T15:30:30.607786+0000","last_peered":"2024-04-25T15:30:30.607786+0000","last_clean":"2024-04-25T15:30:30.607786+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:30:30.607786+0000","last_undegraded":"2024-04-25T15:30:30.607786+0000","last_fullsized":"2024-04-25T15:30:30.607786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2474,"log_dups_size":0,"ondisk_log_size":2474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:34.973087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2548,"num_write_kb":13580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"41'3455","reported_seq":2793,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.255926+0000","last_change":"2024-04-25T15:30:44.256612+0000","last_active":"2024-04-25T15:30:44.255926+0000","last_peered":"2024-04-25T15:30:44.255926+0000","last_clean":"2024-04-25T15:30:44.255926+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:30:44.255926+0000","last_undegraded":"2024-04-25T15:30:44.255926+0000","last_fullsized":"2024-04-25T15:30:44.255926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3455,"log_dups_size":0,"ondisk_log_size":3455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:39:13.576915+0000","scrub_duration":0,"objects_trimmed":712,"snaptrim_duration":13.655509435999999,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1224,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.d","version":"40'4442","reported_seq":4501,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600901+0000","last_change":"2024-04-25T15:20:41.410562+0000","last_active":"2024-04-25T15:30:30.600901+0000","last_peered":"2024-04-25T15:30:30.600901+0000","last_clean":"2024-04-25T15:30:30.600901+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:30:30.600901+0000","last_undegraded":"2024-04-25T15:30:30.600901+0000","last_fullsized":"2024-04-25T15:30:30.600901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583135,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":4527,"num_write_kb":26836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"41'3539","reported_seq":2837,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.797302+0000","last_change":"2024-04-25T15:30:43.797752+0000","last_active":"2024-04-25T15:30:43.797302+0000","last_peered":"2024-04-25T15:30:43.797302+0000","last_clean":"2024-04-25T15:30:43.797302+0000","last_became_active":"2024-04-25T15:21:23.537569+0000","last_became_peered":"2024-04-25T15:21:23.537569+0000","last_unstale":"2024-04-25T15:30:43.797302+0000","last_undegraded":"2024-04-25T15:30:43.797302+0000","last_fullsized":"2024-04-25T15:30:43.797302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3539,"log_dups_size":0,"ondisk_log_size":3539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:57.114192+0000","scrub_duration":0,"objects_trimmed":722,"snaptrim_duration":13.203520253000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.c","version":"40'2074","reported_seq":2133,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.611756+0000","last_change":"2024-04-25T15:20:41.404065+0000","last_active":"2024-04-25T15:30:30.611756+0000","last_peered":"2024-04-25T15:30:30.611756+0000","last_clean":"2024-04-25T15:30:30.611756+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:30:30.611756+0000","last_undegraded":"2024-04-25T15:30:30.611756+0000","last_fullsized":"2024-04-25T15:30:30.611756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:51.189134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":2143,"num_write_kb":17826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"41'3514","reported_seq":2802,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:44.059565+0000","last_change":"2024-04-25T15:30:44.060166+0000","last_active":"2024-04-25T15:30:44.059565+0000","last_peered":"2024-04-25T15:30:44.059565+0000","last_clean":"2024-04-25T15:30:44.059565+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:30:44.059565+0000","last_undegraded":"2024-04-25T15:30:44.059565+0000","last_fullsized":"2024-04-25T15:30:44.059565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3514,"log_dups_size":0,"ondisk_log_size":3514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:16.090008+0000","scrub_duration":0,"objects_trimmed":702,"snaptrim_duration":13.462059612999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"1.0","version":"15'72","reported_seq":157,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602229+0000","last_change":"2024-04-25T15:20:30.873208+0000","last_active":"2024-04-25T15:30:30.602229+0000","last_peered":"2024-04-25T15:30:30.602229+0000","last_clean":"2024-04-25T15:30:30.602229+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:30:30.602229+0000","last_undegraded":"2024-04-25T15:30:30.602229+0000","last_fullsized":"2024-04-25T15:30:30.602229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:29.835147+0000","last_clean_scrub_stamp":"2024-04-25T15:20:29.835147+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:59.356200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"40'1171","reported_seq":1231,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593277+0000","last_change":"2024-04-25T15:20:41.403922+0000","last_active":"2024-04-25T15:30:30.593277+0000","last_peered":"2024-04-25T15:30:30.593277+0000","last_clean":"2024-04-25T15:30:30.593277+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:30:30.593277+0000","last_undegraded":"2024-04-25T15:30:30.593277+0000","last_fullsized":"2024-04-25T15:30:30.593277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1252,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"41'3044","reported_seq":2482,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:41.255626+0000","last_change":"2024-04-25T15:30:41.255670+0000","last_active":"2024-04-25T15:30:41.255626+0000","last_peered":"2024-04-25T15:30:41.255626+0000","last_clean":"2024-04-25T15:30:41.255626+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:30:41.255626+0000","last_undegraded":"2024-04-25T15:30:41.255626+0000","last_fullsized":"2024-04-25T15:30:41.255626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3044,"log_dups_size":0,"ondisk_log_size":3044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:33.739781+0000","scrub_duration":0,"objects_trimmed":251,"snaptrim_duration":10.665544706,"stat_sum":{"num_bytes":2676,"num_objects":447,"num_object_clones":223,"num_object_copies":894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":447,"num_whiteouts":223,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.0","version":"41'3615","reported_seq":3676,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:36.915081+0000","last_change":"2024-04-25T15:20:41.410568+0000","last_active":"2024-04-25T15:30:36.915081+0000","last_peered":"2024-04-25T15:30:36.915081+0000","last_clean":"2024-04-25T15:30:36.915081+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:30:36.915081+0000","last_undegraded":"2024-04-25T15:30:36.915081+0000","last_fullsized":"2024-04-25T15:30:36.915081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3615,"log_dups_size":0,"ondisk_log_size":3615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:02.407728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6520497,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":3670,"num_write_kb":20386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"41'3586","reported_seq":2842,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:41.740584+0000","last_change":"2024-04-25T15:30:41.740633+0000","last_active":"2024-04-25T15:30:41.740584+0000","last_peered":"2024-04-25T15:30:41.740584+0000","last_clean":"2024-04-25T15:30:41.740584+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:30:41.740584+0000","last_undegraded":"2024-04-25T15:30:41.740584+0000","last_fullsized":"2024-04-25T15:30:41.740584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3586,"log_dups_size":0,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:26:46.761461+0000","scrub_duration":0,"objects_trimmed":698,"snaptrim_duration":11.147562825,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.1","version":"40'2374","reported_seq":2747,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.608333+0000","last_change":"2024-04-25T15:20:41.406046+0000","last_active":"2024-04-25T15:30:30.608333+0000","last_peered":"2024-04-25T15:30:30.608333+0000","last_clean":"2024-04-25T15:30:30.608333+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:30:30.608333+0000","last_undegraded":"2024-04-25T15:30:30.608333+0000","last_fullsized":"2024-04-25T15:30:30.608333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2374,"log_dups_size":0,"ondisk_log_size":2374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11691863,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":329,"num_read_kb":3430,"num_write":2430,"num_write_kb":16848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"41'3413","reported_seq":2736,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:41.360600+0000","last_change":"2024-04-25T15:30:41.360600+0000","last_active":"2024-04-25T15:30:41.360600+0000","last_peered":"2024-04-25T15:30:41.360600+0000","last_clean":"2024-04-25T15:30:41.360600+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:30:41.360600+0000","last_undegraded":"2024-04-25T15:30:41.360600+0000","last_fullsized":"2024-04-25T15:30:41.360600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:20.257648+0000","scrub_duration":0,"objects_trimmed":723,"snaptrim_duration":10.760873258,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.2","version":"40'6781","reported_seq":6841,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.594013+0000","last_change":"2024-04-25T15:20:41.410676+0000","last_active":"2024-04-25T15:30:30.594013+0000","last_peered":"2024-04-25T15:30:30.594013+0000","last_clean":"2024-04-25T15:30:30.594013+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:30:30.594013+0000","last_undegraded":"2024-04-25T15:30:30.594013+0000","last_fullsized":"2024-04-25T15:30:30.594013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6781,"log_dups_size":0,"ondisk_log_size":6781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":6828,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"41'3641","reported_seq":2884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:38.676561+0000","last_change":"2024-04-25T15:30:38.676800+0000","last_active":"2024-04-25T15:30:38.676561+0000","last_peered":"2024-04-25T15:30:38.676561+0000","last_clean":"2024-04-25T15:30:38.676561+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:30:38.676561+0000","last_undegraded":"2024-04-25T15:30:38.676561+0000","last_fullsized":"2024-04-25T15:30:38.676561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3641,"log_dups_size":0,"ondisk_log_size":3641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:18.134412+0000","scrub_duration":0,"objects_trimmed":737,"snaptrim_duration":8.0788980660000007,"stat_sum":{"num_bytes":21,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1263,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.4","version":"40'144","reported_seq":203,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599943+0000","last_change":"2024-04-25T15:20:41.413703+0000","last_active":"2024-04-25T15:30:30.599943+0000","last_peered":"2024-04-25T15:30:30.599943+0000","last_clean":"2024-04-25T15:30:30.599943+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:30:30.599943+0000","last_undegraded":"2024-04-25T15:30:30.599943+0000","last_fullsized":"2024-04-25T15:30:30.599943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":208,"num_write_kb":8700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"41'3247","reported_seq":2613,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.797832+0000","last_change":"2024-04-25T15:30:43.798318+0000","last_active":"2024-04-25T15:30:43.797832+0000","last_peered":"2024-04-25T15:30:43.797832+0000","last_clean":"2024-04-25T15:30:43.797832+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:30:43.797832+0000","last_undegraded":"2024-04-25T15:30:43.797832+0000","last_fullsized":"2024-04-25T15:30:43.797832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3247,"log_dups_size":0,"ondisk_log_size":3247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:33:53.738899+0000","scrub_duration":0,"objects_trimmed":659,"snaptrim_duration":13.203930687,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.5","version":"40'1973","reported_seq":2033,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598648+0000","last_change":"2024-04-25T15:20:41.408759+0000","last_active":"2024-04-25T15:30:30.598648+0000","last_peered":"2024-04-25T15:30:30.598648+0000","last_clean":"2024-04-25T15:30:30.598648+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:30:30.598648+0000","last_undegraded":"2024-04-25T15:30:30.598648+0000","last_fullsized":"2024-04-25T15:30:30.598648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1973,"log_dups_size":0,"ondisk_log_size":1973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:41.992733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2030,"num_write_kb":21675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"41'3470","reported_seq":2789,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:41.363558+0000","last_change":"2024-04-25T15:30:41.364628+0000","last_active":"2024-04-25T15:30:41.363558+0000","last_peered":"2024-04-25T15:30:41.363558+0000","last_clean":"2024-04-25T15:30:41.363558+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:30:41.363558+0000","last_undegraded":"2024-04-25T15:30:41.363558+0000","last_fullsized":"2024-04-25T15:30:41.363558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3470,"log_dups_size":0,"ondisk_log_size":3470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:26.387482+0000","scrub_duration":0,"objects_trimmed":690,"snaptrim_duration":10.764830177,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.6","version":"41'2504","reported_seq":2563,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.601549+0000","last_change":"2024-04-25T15:20:41.409877+0000","last_active":"2024-04-25T15:30:30.601549+0000","last_peered":"2024-04-25T15:30:30.601549+0000","last_clean":"2024-04-25T15:30:30.601549+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:30:30.601549+0000","last_undegraded":"2024-04-25T15:30:30.601549+0000","last_fullsized":"2024-04-25T15:30:30.601549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2504,"log_dups_size":0,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3243,"num_write_kb":16596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"41'3510","reported_seq":2834,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:44.850825+0000","last_change":"2024-04-25T15:30:44.283756+0000","last_active":"2024-04-25T15:30:44.850825+0000","last_peered":"2024-04-25T15:30:44.850825+0000","last_clean":"2024-04-25T15:30:44.850825+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:30:44.850825+0000","last_undegraded":"2024-04-25T15:30:44.850825+0000","last_fullsized":"2024-04-25T15:30:44.850825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3510,"log_dups_size":0,"ondisk_log_size":3510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:45.298428+0000","scrub_duration":0,"objects_trimmed":679,"snaptrim_duration":10.063211795999999,"stat_sum":{"num_bytes":4324,"num_objects":39,"num_object_clones":19,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":19,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.7","version":"40'133","reported_seq":193,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.602613+0000","last_change":"2024-04-25T15:20:41.410949+0000","last_active":"2024-04-25T15:30:30.602613+0000","last_peered":"2024-04-25T15:30:30.602613+0000","last_clean":"2024-04-25T15:30:30.602613+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:30:30.602613+0000","last_undegraded":"2024-04-25T15:30:30.602613+0000","last_fullsized":"2024-04-25T15:30:30.602613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:58:32.461510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":213,"num_write_kb":8722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"41'3272","reported_seq":2630,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:44.625911+0000","last_change":"2024-04-25T15:30:44.625960+0000","last_active":"2024-04-25T15:30:44.625911+0000","last_peered":"2024-04-25T15:30:44.625911+0000","last_clean":"2024-04-25T15:30:44.625911+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:44.625911+0000","last_undegraded":"2024-04-25T15:30:44.625911+0000","last_fullsized":"2024-04-25T15:30:44.625911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3272,"log_dups_size":0,"ondisk_log_size":3272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:44.556786+0000","scrub_duration":0,"objects_trimmed":654,"snaptrim_duration":14.031555995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.8","version":"40'1036","reported_seq":1096,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600029+0000","last_change":"2024-04-25T15:20:41.405078+0000","last_active":"2024-04-25T15:30:30.600029+0000","last_peered":"2024-04-25T15:30:30.600029+0000","last_clean":"2024-04-25T15:30:30.600029+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:30:30.600029+0000","last_undegraded":"2024-04-25T15:30:30.600029+0000","last_fullsized":"2024-04-25T15:30:30.600029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:45:20.368683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1104,"num_write_kb":9199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"41'3352","reported_seq":2651,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.171838+0000","last_change":"2024-04-25T15:30:39.172045+0000","last_active":"2024-04-25T15:30:39.171838+0000","last_peered":"2024-04-25T15:30:39.171838+0000","last_clean":"2024-04-25T15:30:39.171838+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:39.171838+0000","last_undegraded":"2024-04-25T15:30:39.171838+0000","last_fullsized":"2024-04-25T15:30:39.171838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3352,"log_dups_size":0,"ondisk_log_size":3352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:59.054566+0000","scrub_duration":0,"objects_trimmed":673,"snaptrim_duration":8.5715076529999994,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.9","version":"40'1878","reported_seq":1937,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599834+0000","last_change":"2024-04-25T15:20:41.411766+0000","last_active":"2024-04-25T15:30:30.599834+0000","last_peered":"2024-04-25T15:30:30.599834+0000","last_clean":"2024-04-25T15:30:30.599834+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:30:30.599834+0000","last_undegraded":"2024-04-25T15:30:30.599834+0000","last_fullsized":"2024-04-25T15:30:30.599834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:46:14.071417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":1954,"num_write_kb":17506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"41'3413","reported_seq":2729,"reported_epoch":41,"state":"active+clean+snaptrim","last_fresh":"2024-04-25T15:30:44.847598+0000","last_change":"2024-04-25T15:30:44.209429+0000","last_active":"2024-04-25T15:30:44.847598+0000","last_peered":"2024-04-25T15:30:44.847598+0000","last_clean":"2024-04-25T15:30:44.847598+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:30:44.847598+0000","last_undegraded":"2024-04-25T15:30:44.847598+0000","last_fullsized":"2024-04-25T15:30:44.847598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3413,"log_dups_size":0,"ondisk_log_size":3413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:25:25.485998+0000","scrub_duration":0,"objects_trimmed":692,"snaptrim_duration":9.7444995799999994,"stat_sum":{"num_bytes":120,"num_objects":21,"num_object_clones":10,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":10,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"1"}]},{"pgid":"2.a","version":"40'3651","reported_seq":3710,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.600436+0000","last_change":"2024-04-25T15:20:41.406926+0000","last_active":"2024-04-25T15:30:30.600436+0000","last_peered":"2024-04-25T15:30:30.600436+0000","last_clean":"2024-04-25T15:30:30.600436+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:30:30.600436+0000","last_undegraded":"2024-04-25T15:30:30.600436+0000","last_fullsized":"2024-04-25T15:30:30.600436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":3651,"log_dups_size":0,"ondisk_log_size":3651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3718,"num_write_kb":26255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"41'3148","reported_seq":2541,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:43.482446+0000","last_change":"2024-04-25T15:30:43.482496+0000","last_active":"2024-04-25T15:30:43.482446+0000","last_peered":"2024-04-25T15:30:43.482446+0000","last_clean":"2024-04-25T15:30:43.482446+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:30:43.482446+0000","last_undegraded":"2024-04-25T15:30:43.482446+0000","last_fullsized":"2024-04-25T15:30:43.482446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3148,"log_dups_size":0,"ondisk_log_size":3148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:53:14.515815+0000","scrub_duration":0,"objects_trimmed":627,"snaptrim_duration":12.892857135,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.b","version":"40'5227","reported_seq":5287,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.599376+0000","last_change":"2024-04-25T15:20:41.408140+0000","last_active":"2024-04-25T15:30:30.599376+0000","last_peered":"2024-04-25T15:30:30.599376+0000","last_clean":"2024-04-25T15:30:30.599376+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:30:30.599376+0000","last_undegraded":"2024-04-25T15:30:30.599376+0000","last_fullsized":"2024-04-25T15:30:30.599376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":5227,"log_dups_size":0,"ondisk_log_size":5227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.707569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":5301,"num_write_kb":30551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"41'3710","reported_seq":2949,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:39.883474+0000","last_change":"2024-04-25T15:30:39.884078+0000","last_active":"2024-04-25T15:30:39.883474+0000","last_peered":"2024-04-25T15:30:39.883474+0000","last_clean":"2024-04-25T15:30:39.883474+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:30:39.883474+0000","last_undegraded":"2024-04-25T15:30:39.883474+0000","last_fullsized":"2024-04-25T15:30:39.883474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3710,"log_dups_size":0,"ondisk_log_size":3710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:23.286828+0000","scrub_duration":0,"objects_trimmed":693,"snaptrim_duration":9.2817127389999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"3.1d","version":"41'3349","reported_seq":2732,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.796301+0000","last_change":"2024-04-25T15:30:43.796301+0000","last_active":"2024-04-25T15:30:43.796301+0000","last_peered":"2024-04-25T15:30:43.796301+0000","last_clean":"2024-04-25T15:30:43.796301+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:30:43.796301+0000","last_undegraded":"2024-04-25T15:30:43.796301+0000","last_fullsized":"2024-04-25T15:30:43.796301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3349,"log_dups_size":0,"ondisk_log_size":3349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:52.844251+0000","scrub_duration":0,"objects_trimmed":668,"snaptrim_duration":13.202123224999999,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.1c","version":"40'1127","reported_seq":1187,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598021+0000","last_change":"2024-04-25T15:20:41.408459+0000","last_active":"2024-04-25T15:30:30.598021+0000","last_peered":"2024-04-25T15:30:30.598021+0000","last_clean":"2024-04-25T15:30:30.598021+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:30:30.598021+0000","last_undegraded":"2024-04-25T15:30:30.598021+0000","last_fullsized":"2024-04-25T15:30:30.598021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:36.356217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1211,"num_write_kb":4844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"41'3803","reported_seq":3038,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:43.799166+0000","last_change":"2024-04-25T15:30:43.799166+0000","last_active":"2024-04-25T15:30:43.799166+0000","last_peered":"2024-04-25T15:30:43.799166+0000","last_clean":"2024-04-25T15:30:43.799166+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:30:43.799166+0000","last_undegraded":"2024-04-25T15:30:43.799166+0000","last_fullsized":"2024-04-25T15:30:43.799166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:12.255072+0000","scrub_duration":0,"objects_trimmed":823,"snaptrim_duration":13.204368401,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1350,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"30","length":"4"}]},{"pgid":"2.1d","version":"40'8160","reported_seq":8220,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.598321+0000","last_change":"2024-04-25T15:20:41.408914+0000","last_active":"2024-04-25T15:30:30.598321+0000","last_peered":"2024-04-25T15:30:30.598321+0000","last_clean":"2024-04-25T15:30:30.598321+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:30:30.598321+0000","last_undegraded":"2024-04-25T15:30:30.598321+0000","last_fullsized":"2024-04-25T15:30:30.598321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":8160,"log_dups_size":0,"ondisk_log_size":8160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:59.598854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":8233,"num_write_kb":32021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"41'3259","reported_seq":2623,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:41.034004+0000","last_change":"2024-04-25T15:30:41.034052+0000","last_active":"2024-04-25T15:30:41.034004+0000","last_peered":"2024-04-25T15:30:41.034004+0000","last_clean":"2024-04-25T15:30:41.034004+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:30:41.034004+0000","last_undegraded":"2024-04-25T15:30:41.034004+0000","last_fullsized":"2024-04-25T15:30:41.034004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3259,"log_dups_size":0,"ondisk_log_size":3259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:11:18.229589+0000","scrub_duration":0,"objects_trimmed":669,"snaptrim_duration":10.441318957,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.1e","version":"40'6121","reported_seq":6182,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.589408+0000","last_change":"2024-04-25T15:20:41.405976+0000","last_active":"2024-04-25T15:30:30.589408+0000","last_peered":"2024-04-25T15:30:30.589408+0000","last_clean":"2024-04-25T15:30:30.589408+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:30:30.589408+0000","last_undegraded":"2024-04-25T15:30:30.589408+0000","last_fullsized":"2024-04-25T15:30:30.589408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":6121,"log_dups_size":0,"ondisk_log_size":6121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:36:43.581331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":6190,"num_write_kb":31064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"41'3451","reported_seq":2750,"reported_epoch":41,"state":"active+clean+snaptrim_wait","last_fresh":"2024-04-25T15:30:42.764030+0000","last_change":"2024-04-25T15:30:42.764030+0000","last_active":"2024-04-25T15:30:42.764030+0000","last_peered":"2024-04-25T15:30:42.764030+0000","last_clean":"2024-04-25T15:30:42.764030+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:30:42.764030+0000","last_undegraded":"2024-04-25T15:30:42.764030+0000","last_fullsized":"2024-04-25T15:30:42.764030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:41.382892+0000","last_clean_scrub_stamp":"2024-04-25T15:20:41.382892+0000","objects_scrubbed":0,"log_size":3451,"log_dups_size":0,"ondisk_log_size":3451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:17.235338+0000","scrub_duration":0,"objects_trimmed":662,"snaptrim_duration":12.174785440000001,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"30","length":"2"}]},{"pgid":"2.1f","version":"40'2537","reported_seq":2597,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T15:30:30.593005+0000","last_change":"2024-04-25T15:20:41.410750+0000","last_active":"2024-04-25T15:30:30.593005+0000","last_peered":"2024-04-25T15:30:30.593005+0000","last_clean":"2024-04-25T15:30:30.593005+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:30:30.593005+0000","last_undegraded":"2024-04-25T15:30:30.593005+0000","last_fullsized":"2024-04-25T15:30:30.593005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T15:20:40.378223+0000","last_clean_scrub_stamp":"2024-04-25T15:20:40.378223+0000","objects_scrubbed":0,"log_size":2537,"log_dups_size":0,"ondisk_log_size":2537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:22.432673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2610,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":133667,"num_objects":1201,"num_object_clones":547,"num_object_copies":2402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1201,"num_whiteouts":539,"num_read":44,"num_read_kb":30,"num_write":77732,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4829184,"data_stored":267536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223393,"ondisk_log_size":223393,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":265677919,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":835,"num_read_kb":3430,"num_write":91102,"num_write_kb":583108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":531415040,"data_stored":531355838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88184,"ondisk_log_size":88184,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435232,"kb_used_data":66712,"kb_used_omap":1,"kb_used_meta":368510,"kb_avail":93936608,"statfs":{"total":96636764160,"available":96191086592,"internally_reserved":0,"allocated":68313088,"data_stored":66086201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":377354698},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":392632,"kb_used_data":82416,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":93979208,"statfs":{"total":96636764160,"available":96234708992,"internally_reserved":0,"allocated":84393984,"data_stored":84115014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574974,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371336,"kb_used_data":83328,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94000504,"statfs":{"total":96636764160,"available":96256516096,"internally_reserved":0,"allocated":85327872,"data_stored":84137618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":294910406},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":409244,"kb_used_data":62932,"kb_used_omap":1,"kb_used_meta":346302,"kb_avail":93962596,"statfs":{"total":96636764160,"available":96217698304,"internally_reserved":0,"allocated":64442368,"data_stored":63146077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":354613702},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574973,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373724,"kb_used_data":71888,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":93998116,"statfs":{"total":96636764160,"available":96254070784,"internally_reserved":0,"allocated":73613312,"data_stored":70677529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":309066183},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193924,"kb_used_data":36476,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94177916,"statfs":{"total":96636764160,"available":96438185984,"internally_reserved":0,"allocated":37351424,"data_stored":37081824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":410204,"kb_used_data":86100,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":93961636,"statfs":{"total":96636764160,"available":96216715264,"internally_reserved":0,"allocated":88166400,"data_stored":86436900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":331872709},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574975,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313660,"kb_used_data":43764,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94058180,"statfs":{"total":96636764160,"available":96315576320,"internally_reserved":0,"allocated":44814336,"data_stored":42767511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86220800,"data_stored":86212586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36859904,"data_stored":36857687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70422528,"data_stored":70412791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62926848,"data_stored":62914839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83890176,"data_stored":83886170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83894272,"data_stored":83886752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65245184,"data_stored":65241335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1171456,"data_stored":27983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":16588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1085440,"data_stored":56292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":26416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":974848,"data_stored":47814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":24628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":798720,"data_stored":47312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:30:49.678 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.678 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.678 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.678 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.679 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.679 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.679 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.679 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.679 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.679 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.679 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.680 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.680 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.680 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.680 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.680 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.680 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.681 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.682 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.682 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.682 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.682 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.682 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.682 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.682 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.682 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.683 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.684 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.685 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T15:20:29.835147+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=29, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.686 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.687 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.688 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.689 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.689 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.689 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.689 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.689 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T15:20:41.382892+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.689 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T15:20:40.378223+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=20, tm_sec=40, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=15, tm_min=30, tm_sec=44, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T15:30:49.689 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T15:31:09.690 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T15:31:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.800+0000 7f808710d640 1 Processor -- start 2024-04-25T15:31:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.801+0000 7f808710d640 1 -- start start 2024-04-25T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f808710d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8080070550 0x7f80800b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f808710d640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8080148360 0x7f8080151f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f808710d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80800b3c50 con 0x7f80800b23e0 2024-04-25T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f808710d640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f80800b8730 con 0x7f8080148360 2024-04-25T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f808710d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f80800b8cf0 con 0x7f8080070550 2024-04-25T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f80856aa640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8080148360 0x7f8080151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f80856aa640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8080148360 0x7f8080151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40108/0 (socket says 172.21.15.33:40108) 2024-04-25T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f80856aa640 1 -- 172.21.15.33:0/387144735 learned_addr learned my addr 172.21.15.33:0/387144735 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f8084ea9640 1 --2- 172.21.15.33:0/387144735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8080070550 0x7f80800b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f80856aa640 1 -- 172.21.15.33:0/387144735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8080070550 msgr2=0x7f80800b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f80856aa640 1 --2- 172.21.15.33:0/387144735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8080070550 0x7f80800b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f80856aa640 1 -- 172.21.15.33:0/387144735 >> v1:172.21.15.155:6789/0 conn(0x7f80800b23e0 legacy=0x7f8080147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.802+0000 7f80856aa640 1 -- 172.21.15.33:0/387144735 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80800b1a70 con 0x7f8080148360 2024-04-25T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.803+0000 7f80856aa640 1 --2- 172.21.15.33:0/387144735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080151f90 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f8078009e50 tx=0x7f807802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b233f60819edfa4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.803+0000 7f807f7fe640 1 -- 172.21.15.33:0/387144735 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078036070 con 0x7f8080148360 2024-04-25T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.803+0000 7f807f7fe640 1 -- 172.21.15.33:0/387144735 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8078031600 con 0x7f8080148360 2024-04-25T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.803+0000 7f807f7fe640 1 -- 172.21.15.33:0/387144735 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80780319d0 con 0x7f8080148360 2024-04-25T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.804+0000 7f808710d640 1 -- 172.21.15.33:0/387144735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 msgr2=0x7f8080151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.804+0000 7f808710d640 1 --2- 172.21.15.33:0/387144735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080151f90 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f8078009e50 tx=0x7f807802a5f0 comp rx=0 tx=0).stop 2024-04-25T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.804+0000 7f808710d640 1 -- 172.21.15.33:0/387144735 shutdown_connections 2024-04-25T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.804+0000 7f808710d640 1 --2- 172.21.15.33:0/387144735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080151f90 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.804+0000 7f808710d640 1 --2- 172.21.15.33:0/387144735 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8080070550 0x7f80800b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.804+0000 7f808710d640 1 -- 172.21.15.33:0/387144735 >> 172.21.15.33:0/387144735 conn(0x7f8080063ad0 msgr2=0x7f80800bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.804+0000 7f808710d640 1 -- 172.21.15.33:0/387144735 shutdown_connections 2024-04-25T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.804+0000 7f808710d640 1 -- 172.21.15.33:0/387144735 wait complete. 2024-04-25T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.806+0000 7f808710d640 1 Processor -- start 2024-04-25T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.806+0000 7f808710d640 1 -- start start 2024-04-25T15:31:09.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f808710d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8080070550 0x7f80801dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:09.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f808710d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80800b23e0 0x7f80801d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:09.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f808710d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:09.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f808710d640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8080148770 con 0x7f8080148360 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f808710d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f80800b3270 con 0x7f8080070550 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f808710d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8080070960 con 0x7f80800b23e0 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f80856aa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f80856aa640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40114/0 (socket says 172.21.15.33:40114) 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f80856aa640 1 -- 172.21.15.33:0/865256757 learned_addr learned my addr 172.21.15.33:0/865256757 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f8084ea9640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8080070550 0x7f80801dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f807ffff640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80800b23e0 0x7f80801d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f80856aa640 1 -- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80800b23e0 msgr2=0x7f80801d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f80856aa640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80800b23e0 0x7f80801d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f80856aa640 1 -- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8080070550 msgr2=0x7f80801dfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f80856aa640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8080070550 0x7f80801dfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f80856aa640 1 -- 172.21.15.33:0/865256757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80801e0040 con 0x7f8080148360 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f807ffff640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80800b23e0 0x7f80801d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.807+0000 7f8084ea9640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8080070550 0x7f80801dfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.808+0000 7f80856aa640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080144db0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f8078034040 tx=0x7f8078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.808+0000 7f807d7fa640 1 -- 172.21.15.33:0/865256757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078036050 con 0x7f8080148360 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.808+0000 7f807d7fa640 1 -- 172.21.15.33:0/865256757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8078042070 con 0x7f8080148360 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.808+0000 7f807d7fa640 1 -- 172.21.15.33:0/865256757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078009510 con 0x7f8080148360 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.808+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80801d2b20 con 0x7f8080148360 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.808+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f808006eea0 con 0x7f8080148360 2024-04-25T15:31:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.809+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80800764e0 con 0x7f8080148360 2024-04-25T15:31:09.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.810+0000 7f807d7fa640 1 -- 172.21.15.33:0/865256757 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8078007bf0 con 0x7f8080148360 2024-04-25T15:31:09.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.811+0000 7f807d7fa640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f80640744b0 0x7f80640769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:09.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.811+0000 7f807d7fa640 1 -- 172.21.15.33:0/865256757 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5896+0+0 (secure 0 0 0) 0x7f80780b6240 con 0x7f8080148360 2024-04-25T15:31:09.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.811+0000 7f8084ea9640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f80640744b0 0x7f80640769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:09.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.811+0000 7f8084ea9640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f80640744b0 0x7f80640769c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8074009a20 tx=0x7f8074008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:09.816+0000 7f807d7fa640 1 -- 172.21.15.33:0/865256757 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8078080870 con 0x7f8080148360 2024-04-25T15:31:10.001 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.000+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 --> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80800b5f40 con 0x7f80640744b0 2024-04-25T15:31:10.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.007+0000 7f807d7fa640 1 -- 172.21.15.33:0/865256757 <== mgr.4100 v2:172.21.15.155:6832/794053036 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+256349 (secure 0 0 0) 0x7f80800b5f40 con 0x7f80640744b0 2024-04-25T15:31:10.011 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:31:10.012 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-04-25T15:31:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f80640744b0 msgr2=0x7f80640769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f80640744b0 0x7f80640769c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8074009a20 tx=0x7f8074008040 comp rx=0 tx=0).stop 2024-04-25T15:31:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 msgr2=0x7f8080144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080144db0 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f8078034040 tx=0x7f8078004a40 comp rx=0 tx=0).stop 2024-04-25T15:31:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 shutdown_connections 2024-04-25T15:31:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f80640744b0 0x7f80640769c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8080148360 0x7f8080144db0 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80800b23e0 0x7f80801d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 --2- 172.21.15.33:0/865256757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8080070550 0x7f80801dfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 >> 172.21.15.33:0/865256757 conn(0x7f8080063ad0 msgr2=0x7f8080075ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 shutdown_connections 2024-04-25T15:31:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.010+0000 7f808710d640 1 -- 172.21.15.33:0/865256757 wait complete. 2024-04-25T15:31:10.022 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-04-25T15:31:09.857124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":266395630,"num_objects":763,"num_object_clones":20,"num_object_copies":1526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":763,"num_whiteouts":12,"num_read":945,"num_read_kb":3515,"num_write":168935,"num_write_kb":625333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3874680,"num_omap_keys":7649,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":313456,"ondisk_log_size":313456,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2873996,"kb_used_data":524296,"kb_used_omap":12,"kb_used_meta":2349619,"kb_avail":752100724,"statfs":{"total":773094113280,"available":770151141376,"internally_reserved":0,"allocated":536879104,"data_stored":534518346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":2406010418},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":510179,"num_omap_keys":1002,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003719"},"pg_stats":[{"pgid":"3.3f","version":"43'3239","reported_seq":2656,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:03.263194+0000","last_change":"2024-04-25T15:31:03.263194+0000","last_active":"2024-04-25T15:31:03.263194+0000","last_peered":"2024-04-25T15:31:03.263194+0000","last_clean":"2024-04-25T15:31:03.263194+0000","last_became_active":"2024-04-25T15:20:42.418409+0000","last_became_peered":"2024-04-25T15:20:42.418409+0000","last_unstale":"2024-04-25T15:31:03.263194+0000","last_undegraded":"2024-04-25T15:31:03.263194+0000","last_fullsized":"2024-04-25T15:31:03.263194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3239","last_scrub_stamp":"2024-04-25T15:31:03.263033+0000","last_deep_scrub":"43'3239","last_deep_scrub_stamp":"2024-04-25T15:31:03.263033+0000","last_clean_scrub_stamp":"2024-04-25T15:31:03.263033+0000","objects_scrubbed":2,"log_size":3239,"log_dups_size":0,"ondisk_log_size":3239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:01.733042+0000","scrub_duration":7,"objects_trimmed":632,"snaptrim_duration":13.463749283,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1146,"num_write_kb":598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"41'3042","reported_seq":2446,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.639415+0000","last_change":"2024-04-25T15:30:54.048505+0000","last_active":"2024-04-25T15:30:57.639415+0000","last_peered":"2024-04-25T15:30:57.639415+0000","last_clean":"2024-04-25T15:30:57.639415+0000","last_became_active":"2024-04-25T15:20:42.417378+0000","last_became_peered":"2024-04-25T15:20:42.417378+0000","last_unstale":"2024-04-25T15:30:57.639415+0000","last_undegraded":"2024-04-25T15:30:57.639415+0000","last_fullsized":"2024-04-25T15:30:57.639415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3042","last_scrub_stamp":"2024-04-25T15:30:54.048384+0000","last_deep_scrub":"41'3042","last_deep_scrub_stamp":"2024-04-25T15:30:54.048384+0000","last_clean_scrub_stamp":"2024-04-25T15:30:54.048384+0000","objects_scrubbed":0,"log_size":3042,"log_dups_size":0,"ondisk_log_size":3042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:30.895082+0000","scrub_duration":4,"objects_trimmed":636,"snaptrim_duration":11.259556594999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"42'3595","reported_seq":2918,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.639356+0000","last_change":"2024-04-25T15:30:51.730334+0000","last_active":"2024-04-25T15:30:57.639356+0000","last_peered":"2024-04-25T15:30:57.639356+0000","last_clean":"2024-04-25T15:30:57.639356+0000","last_became_active":"2024-04-25T15:20:42.414492+0000","last_became_peered":"2024-04-25T15:20:42.414492+0000","last_unstale":"2024-04-25T15:30:57.639356+0000","last_undegraded":"2024-04-25T15:30:57.639356+0000","last_fullsized":"2024-04-25T15:30:57.639356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3595","last_scrub_stamp":"2024-04-25T15:30:51.730204+0000","last_deep_scrub":"42'3595","last_deep_scrub_stamp":"2024-04-25T15:30:51.730204+0000","last_clean_scrub_stamp":"2024-04-25T15:30:51.730204+0000","objects_scrubbed":4,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:50.470343+0000","scrub_duration":8,"objects_trimmed":691,"snaptrim_duration":14.602597018999999,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1170,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"42'3598","reported_seq":2867,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.470966+0000","last_change":"2024-04-25T15:30:55.462911+0000","last_active":"2024-04-25T15:30:57.470966+0000","last_peered":"2024-04-25T15:30:57.470966+0000","last_clean":"2024-04-25T15:30:57.470966+0000","last_became_active":"2024-04-25T15:20:42.422452+0000","last_became_peered":"2024-04-25T15:20:42.422452+0000","last_unstale":"2024-04-25T15:30:57.470966+0000","last_undegraded":"2024-04-25T15:30:57.470966+0000","last_fullsized":"2024-04-25T15:30:57.470966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3598","last_scrub_stamp":"2024-04-25T15:30:55.462727+0000","last_deep_scrub":"42'3598","last_deep_scrub_stamp":"2024-04-25T15:30:55.462727+0000","last_clean_scrub_stamp":"2024-04-25T15:30:55.462727+0000","objects_scrubbed":6,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:05.246793+0000","scrub_duration":14,"objects_trimmed":768,"snaptrim_duration":13.201226914999999,"stat_sum":{"num_bytes":8203,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1296,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"43'3627","reported_seq":2890,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:02.242715+0000","last_change":"2024-04-25T15:31:02.242751+0000","last_active":"2024-04-25T15:31:02.242715+0000","last_peered":"2024-04-25T15:31:02.242715+0000","last_clean":"2024-04-25T15:31:02.242715+0000","last_became_active":"2024-04-25T15:20:42.417086+0000","last_became_peered":"2024-04-25T15:20:42.417086+0000","last_unstale":"2024-04-25T15:31:02.242715+0000","last_undegraded":"2024-04-25T15:31:02.242715+0000","last_fullsized":"2024-04-25T15:31:02.242715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3627","last_scrub_stamp":"2024-04-25T15:31:02.242607+0000","last_deep_scrub":"43'3627","last_deep_scrub_stamp":"2024-04-25T15:31:02.242607+0000","last_clean_scrub_stamp":"2024-04-25T15:31:02.242607+0000","objects_scrubbed":1,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:19.300094+0000","scrub_duration":5,"objects_trimmed":724,"snaptrim_duration":13.464445567,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"42'3484","reported_seq":2784,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.345673+0000","last_change":"2024-04-25T15:30:53.867328+0000","last_active":"2024-04-25T15:30:57.345673+0000","last_peered":"2024-04-25T15:30:57.345673+0000","last_clean":"2024-04-25T15:30:57.345673+0000","last_became_active":"2024-04-25T15:21:23.754462+0000","last_became_peered":"2024-04-25T15:21:23.754462+0000","last_unstale":"2024-04-25T15:30:57.345673+0000","last_undegraded":"2024-04-25T15:30:57.345673+0000","last_fullsized":"2024-04-25T15:30:57.345673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3484","last_scrub_stamp":"2024-04-25T15:30:53.867137+0000","last_deep_scrub":"42'3484","last_deep_scrub_stamp":"2024-04-25T15:30:53.867137+0000","last_clean_scrub_stamp":"2024-04-25T15:30:53.867137+0000","objects_scrubbed":1,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:01:04.644385+0000","scrub_duration":7,"objects_trimmed":689,"snaptrim_duration":8.0917395699999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1163,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"42'3290","reported_seq":2671,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.346512+0000","last_change":"2024-04-25T15:30:50.286032+0000","last_active":"2024-04-25T15:30:57.346512+0000","last_peered":"2024-04-25T15:30:57.346512+0000","last_clean":"2024-04-25T15:30:57.346512+0000","last_became_active":"2024-04-25T15:20:42.413283+0000","last_became_peered":"2024-04-25T15:20:42.413283+0000","last_unstale":"2024-04-25T15:30:57.346512+0000","last_undegraded":"2024-04-25T15:30:57.346512+0000","last_fullsized":"2024-04-25T15:30:57.346512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3290","last_scrub_stamp":"2024-04-25T15:30:50.285920+0000","last_deep_scrub":"42'3290","last_deep_scrub_stamp":"2024-04-25T15:30:50.285920+0000","last_clean_scrub_stamp":"2024-04-25T15:30:50.285920+0000","objects_scrubbed":4,"log_size":3290,"log_dups_size":0,"ondisk_log_size":3290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:50.659948+0000","scrub_duration":11,"objects_trimmed":681,"snaptrim_duration":13.461782324,"stat_sum":{"num_bytes":4196,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1188,"num_write_kb":622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"43'3159","reported_seq":2551,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:59.506169+0000","last_change":"2024-04-25T15:30:59.506233+0000","last_active":"2024-04-25T15:30:59.506169+0000","last_peered":"2024-04-25T15:30:59.506169+0000","last_clean":"2024-04-25T15:30:59.506169+0000","last_became_active":"2024-04-25T15:20:42.431578+0000","last_became_peered":"2024-04-25T15:20:42.431578+0000","last_unstale":"2024-04-25T15:30:59.506169+0000","last_undegraded":"2024-04-25T15:30:59.506169+0000","last_fullsized":"2024-04-25T15:30:59.506169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3159","last_scrub_stamp":"2024-04-25T15:30:59.506038+0000","last_deep_scrub":"43'3159","last_deep_scrub_stamp":"2024-04-25T15:30:59.506038+0000","last_clean_scrub_stamp":"2024-04-25T15:30:59.506038+0000","objects_scrubbed":1,"log_size":3159,"log_dups_size":0,"ondisk_log_size":3159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:52.146861+0000","scrub_duration":7,"objects_trimmed":675,"snaptrim_duration":14.315791163,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1148,"num_write_kb":607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"43'3544","reported_seq":2884,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:05.194958+0000","last_change":"2024-04-25T15:31:05.194998+0000","last_active":"2024-04-25T15:31:05.194958+0000","last_peered":"2024-04-25T15:31:05.194958+0000","last_clean":"2024-04-25T15:31:05.194958+0000","last_became_active":"2024-04-25T15:20:42.420119+0000","last_became_peered":"2024-04-25T15:20:42.420119+0000","last_unstale":"2024-04-25T15:31:05.194958+0000","last_undegraded":"2024-04-25T15:31:05.194958+0000","last_fullsized":"2024-04-25T15:31:05.194958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3544","last_scrub_stamp":"2024-04-25T15:31:05.194845+0000","last_deep_scrub":"43'3544","last_deep_scrub_stamp":"2024-04-25T15:31:05.194845+0000","last_clean_scrub_stamp":"2024-04-25T15:31:05.194845+0000","objects_scrubbed":2,"log_size":3544,"log_dups_size":0,"ondisk_log_size":3544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:20:35.004647+0000","scrub_duration":8,"objects_trimmed":709,"snaptrim_duration":13.464945373000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1270,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"43'3425","reported_seq":2840,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:00.331718+0000","last_change":"2024-04-25T15:31:00.331764+0000","last_active":"2024-04-25T15:31:00.331718+0000","last_peered":"2024-04-25T15:31:00.331718+0000","last_clean":"2024-04-25T15:31:00.331718+0000","last_became_active":"2024-04-25T15:20:42.427849+0000","last_became_peered":"2024-04-25T15:20:42.427849+0000","last_unstale":"2024-04-25T15:31:00.331718+0000","last_undegraded":"2024-04-25T15:31:00.331718+0000","last_fullsized":"2024-04-25T15:31:00.331718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3425","last_scrub_stamp":"2024-04-25T15:31:00.331610+0000","last_deep_scrub":"43'3425","last_deep_scrub_stamp":"2024-04-25T15:31:00.331610+0000","last_clean_scrub_stamp":"2024-04-25T15:31:00.331610+0000","objects_scrubbed":4,"log_size":3425,"log_dups_size":0,"ondisk_log_size":3425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:16.062910+0000","scrub_duration":13,"objects_trimmed":653,"snaptrim_duration":9.2808164089999998,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1108,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"42'3367","reported_seq":2729,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.358130+0000","last_change":"2024-04-25T15:30:56.339303+0000","last_active":"2024-04-25T15:30:57.358130+0000","last_peered":"2024-04-25T15:30:57.358130+0000","last_clean":"2024-04-25T15:30:57.358130+0000","last_became_active":"2024-04-25T15:20:42.420336+0000","last_became_peered":"2024-04-25T15:20:42.420336+0000","last_unstale":"2024-04-25T15:30:57.358130+0000","last_undegraded":"2024-04-25T15:30:57.358130+0000","last_fullsized":"2024-04-25T15:30:57.358130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3367","last_scrub_stamp":"2024-04-25T15:30:56.339169+0000","last_deep_scrub":"42'3367","last_deep_scrub_stamp":"2024-04-25T15:30:56.339169+0000","last_clean_scrub_stamp":"2024-04-25T15:30:56.339169+0000","objects_scrubbed":2,"log_size":3367,"log_dups_size":0,"ondisk_log_size":3367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:38.702587+0000","scrub_duration":10,"objects_trimmed":691,"snaptrim_duration":9.2803684680000007,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"42'3668","reported_seq":2930,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.348435+0000","last_change":"2024-04-25T15:30:50.353220+0000","last_active":"2024-04-25T15:30:57.348435+0000","last_peered":"2024-04-25T15:30:57.348435+0000","last_clean":"2024-04-25T15:30:57.348435+0000","last_became_active":"2024-04-25T15:20:42.412375+0000","last_became_peered":"2024-04-25T15:20:42.412375+0000","last_unstale":"2024-04-25T15:30:57.348435+0000","last_undegraded":"2024-04-25T15:30:57.348435+0000","last_fullsized":"2024-04-25T15:30:57.348435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3668","last_scrub_stamp":"2024-04-25T15:30:50.353093+0000","last_deep_scrub":"42'3668","last_deep_scrub_stamp":"2024-04-25T15:30:50.353093+0000","last_clean_scrub_stamp":"2024-04-25T15:30:50.353093+0000","objects_scrubbed":1,"log_size":3668,"log_dups_size":0,"ondisk_log_size":3668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:27:58.547712+0000","scrub_duration":7,"objects_trimmed":759,"snaptrim_duration":8.0780853560000008,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"42'3257","reported_seq":2665,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.473328+0000","last_change":"2024-04-25T15:30:55.491799+0000","last_active":"2024-04-25T15:30:57.473328+0000","last_peered":"2024-04-25T15:30:57.473328+0000","last_clean":"2024-04-25T15:30:57.473328+0000","last_became_active":"2024-04-25T15:20:42.427584+0000","last_became_peered":"2024-04-25T15:20:42.427584+0000","last_unstale":"2024-04-25T15:30:57.473328+0000","last_undegraded":"2024-04-25T15:30:57.473328+0000","last_fullsized":"2024-04-25T15:30:57.473328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3257","last_scrub_stamp":"2024-04-25T15:30:55.491684+0000","last_deep_scrub":"42'3257","last_deep_scrub_stamp":"2024-04-25T15:30:55.491684+0000","last_clean_scrub_stamp":"2024-04-25T15:30:55.491684+0000","objects_scrubbed":3,"log_size":3257,"log_dups_size":0,"ondisk_log_size":3257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:40.150369+0000","scrub_duration":9,"objects_trimmed":647,"snaptrim_duration":14.316800013,"stat_sum":{"num_bytes":4128,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1152,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"42'3314","reported_seq":2668,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638238+0000","last_change":"2024-04-25T15:30:53.776591+0000","last_active":"2024-04-25T15:30:57.638238+0000","last_peered":"2024-04-25T15:30:57.638238+0000","last_clean":"2024-04-25T15:30:57.638238+0000","last_became_active":"2024-04-25T15:20:42.417309+0000","last_became_peered":"2024-04-25T15:20:42.417309+0000","last_unstale":"2024-04-25T15:30:57.638238+0000","last_undegraded":"2024-04-25T15:30:57.638238+0000","last_fullsized":"2024-04-25T15:30:57.638238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3314","last_scrub_stamp":"2024-04-25T15:30:53.776400+0000","last_deep_scrub":"42'3314","last_deep_scrub_stamp":"2024-04-25T15:30:53.776400+0000","last_clean_scrub_stamp":"2024-04-25T15:30:53.776400+0000","objects_scrubbed":2,"log_size":3314,"log_dups_size":0,"ondisk_log_size":3314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:47:55.843709+0000","scrub_duration":9,"objects_trimmed":716,"snaptrim_duration":14.601840255000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1224,"num_write_kb":636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"42'3620","reported_seq":2897,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.639109+0000","last_change":"2024-04-25T15:30:53.042070+0000","last_active":"2024-04-25T15:30:57.639109+0000","last_peered":"2024-04-25T15:30:57.639109+0000","last_clean":"2024-04-25T15:30:57.639109+0000","last_became_active":"2024-04-25T15:20:42.415568+0000","last_became_peered":"2024-04-25T15:20:42.415568+0000","last_unstale":"2024-04-25T15:30:57.639109+0000","last_undegraded":"2024-04-25T15:30:57.639109+0000","last_fullsized":"2024-04-25T15:30:57.639109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3620","last_scrub_stamp":"2024-04-25T15:30:53.041967+0000","last_deep_scrub":"42'3620","last_deep_scrub_stamp":"2024-04-25T15:30:53.041967+0000","last_clean_scrub_stamp":"2024-04-25T15:30:53.041967+0000","objects_scrubbed":2,"log_size":3620,"log_dups_size":0,"ondisk_log_size":3620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:19.200097+0000","scrub_duration":8,"objects_trimmed":722,"snaptrim_duration":10.763348572,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"43'3740","reported_seq":3024,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:58.453951+0000","last_change":"2024-04-25T15:30:58.453989+0000","last_active":"2024-04-25T15:30:58.453951+0000","last_peered":"2024-04-25T15:30:58.453951+0000","last_clean":"2024-04-25T15:30:58.453951+0000","last_became_active":"2024-04-25T15:20:42.423598+0000","last_became_peered":"2024-04-25T15:20:42.423598+0000","last_unstale":"2024-04-25T15:30:58.453951+0000","last_undegraded":"2024-04-25T15:30:58.453951+0000","last_fullsized":"2024-04-25T15:30:58.453951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3740","last_scrub_stamp":"2024-04-25T15:30:58.453847+0000","last_deep_scrub":"43'3740","last_deep_scrub_stamp":"2024-04-25T15:30:58.453847+0000","last_clean_scrub_stamp":"2024-04-25T15:30:58.453847+0000","objects_scrubbed":5,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:24:57.285860+0000","scrub_duration":12,"objects_trimmed":699,"snaptrim_duration":13.20232268,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"43'3542","reported_seq":2857,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:59.420050+0000","last_change":"2024-04-25T15:30:59.420096+0000","last_active":"2024-04-25T15:30:59.420050+0000","last_peered":"2024-04-25T15:30:59.420050+0000","last_clean":"2024-04-25T15:30:59.420050+0000","last_became_active":"2024-04-25T15:20:42.426645+0000","last_became_peered":"2024-04-25T15:20:42.426645+0000","last_unstale":"2024-04-25T15:30:59.420050+0000","last_undegraded":"2024-04-25T15:30:59.420050+0000","last_fullsized":"2024-04-25T15:30:59.420050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3542","last_scrub_stamp":"2024-04-25T15:30:59.419950+0000","last_deep_scrub":"43'3542","last_deep_scrub_stamp":"2024-04-25T15:30:59.419950+0000","last_clean_scrub_stamp":"2024-04-25T15:30:59.419950+0000","objects_scrubbed":5,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:19:44.078636+0000","scrub_duration":14,"objects_trimmed":765,"snaptrim_duration":13.203251995,"stat_sum":{"num_bytes":4127,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":1332,"num_write_kb":718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"42'3382","reported_seq":2781,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.345783+0000","last_change":"2024-04-25T15:30:51.824869+0000","last_active":"2024-04-25T15:30:57.345783+0000","last_peered":"2024-04-25T15:30:57.345783+0000","last_clean":"2024-04-25T15:30:57.345783+0000","last_became_active":"2024-04-25T15:20:42.415829+0000","last_became_peered":"2024-04-25T15:20:42.415829+0000","last_unstale":"2024-04-25T15:30:57.345783+0000","last_undegraded":"2024-04-25T15:30:57.345783+0000","last_fullsized":"2024-04-25T15:30:57.345783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3382","last_scrub_stamp":"2024-04-25T15:30:51.824749+0000","last_deep_scrub":"42'3382","last_deep_scrub_stamp":"2024-04-25T15:30:51.824749+0000","last_clean_scrub_stamp":"2024-04-25T15:30:51.824749+0000","objects_scrubbed":1,"log_size":3382,"log_dups_size":0,"ondisk_log_size":3382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:46.763040+0000","scrub_duration":7,"objects_trimmed":607,"snaptrim_duration":6.6868273169999997,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1074,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"43'3372","reported_seq":2730,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:04.218073+0000","last_change":"2024-04-25T15:31:04.218123+0000","last_active":"2024-04-25T15:31:04.218073+0000","last_peered":"2024-04-25T15:31:04.218073+0000","last_clean":"2024-04-25T15:31:04.218073+0000","last_became_active":"2024-04-25T15:20:42.419081+0000","last_became_peered":"2024-04-25T15:20:42.419081+0000","last_unstale":"2024-04-25T15:31:04.218073+0000","last_undegraded":"2024-04-25T15:31:04.218073+0000","last_fullsized":"2024-04-25T15:31:04.218073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3372","last_scrub_stamp":"2024-04-25T15:31:04.217965+0000","last_deep_scrub":"43'3372","last_deep_scrub_stamp":"2024-04-25T15:31:04.217965+0000","last_clean_scrub_stamp":"2024-04-25T15:31:04.217965+0000","objects_scrubbed":3,"log_size":3372,"log_dups_size":0,"ondisk_log_size":3372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:00.680474+0000","scrub_duration":9,"objects_trimmed":675,"snaptrim_duration":13.463314562000001,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1215,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"43'3685","reported_seq":3017,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.372123+0000","last_change":"2024-04-25T15:30:57.372164+0000","last_active":"2024-04-25T15:30:57.372123+0000","last_peered":"2024-04-25T15:30:57.372123+0000","last_clean":"2024-04-25T15:30:57.372123+0000","last_became_active":"2024-04-25T15:20:42.421369+0000","last_became_peered":"2024-04-25T15:20:42.421369+0000","last_unstale":"2024-04-25T15:30:57.372123+0000","last_undegraded":"2024-04-25T15:30:57.372123+0000","last_fullsized":"2024-04-25T15:30:57.372123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3685","last_scrub_stamp":"2024-04-25T15:30:57.372038+0000","last_deep_scrub":"43'3685","last_deep_scrub_stamp":"2024-04-25T15:30:57.372038+0000","last_clean_scrub_stamp":"2024-04-25T15:30:57.372038+0000","objects_scrubbed":2,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:10:13.093512+0000","scrub_duration":8,"objects_trimmed":721,"snaptrim_duration":9.2820153750000003,"stat_sum":{"num_bytes":4105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"42'3298","reported_seq":2686,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638337+0000","last_change":"2024-04-25T15:30:54.774730+0000","last_active":"2024-04-25T15:30:57.638337+0000","last_peered":"2024-04-25T15:30:57.638337+0000","last_clean":"2024-04-25T15:30:57.638337+0000","last_became_active":"2024-04-25T15:20:42.416315+0000","last_became_peered":"2024-04-25T15:20:42.416315+0000","last_unstale":"2024-04-25T15:30:57.638337+0000","last_undegraded":"2024-04-25T15:30:57.638337+0000","last_fullsized":"2024-04-25T15:30:57.638337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3298","last_scrub_stamp":"2024-04-25T15:30:54.774619+0000","last_deep_scrub":"42'3298","last_deep_scrub_stamp":"2024-04-25T15:30:54.774619+0000","last_clean_scrub_stamp":"2024-04-25T15:30:54.774619+0000","objects_scrubbed":3,"log_size":3298,"log_dups_size":0,"ondisk_log_size":3298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:47.849399+0000","scrub_duration":11,"objects_trimmed":666,"snaptrim_duration":14.629020969999999,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1177,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"43'3976","reported_seq":3210,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:00.394669+0000","last_change":"2024-04-25T15:31:00.394710+0000","last_active":"2024-04-25T15:31:00.394669+0000","last_peered":"2024-04-25T15:31:00.394669+0000","last_clean":"2024-04-25T15:31:00.394669+0000","last_became_active":"2024-04-25T15:20:42.427732+0000","last_became_peered":"2024-04-25T15:20:42.427732+0000","last_unstale":"2024-04-25T15:31:00.394669+0000","last_undegraded":"2024-04-25T15:31:00.394669+0000","last_fullsized":"2024-04-25T15:31:00.394669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3976","last_scrub_stamp":"2024-04-25T15:31:00.394549+0000","last_deep_scrub":"43'3976","last_deep_scrub_stamp":"2024-04-25T15:31:00.394549+0000","last_clean_scrub_stamp":"2024-04-25T15:31:00.394549+0000","objects_scrubbed":1,"log_size":3976,"log_dups_size":0,"ondisk_log_size":3976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:39.748413+0000","scrub_duration":8,"objects_trimmed":777,"snaptrim_duration":13.240644691,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"41'3287","reported_seq":2667,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.473150+0000","last_change":"2024-04-25T15:30:53.499949+0000","last_active":"2024-04-25T15:30:57.473150+0000","last_peered":"2024-04-25T15:30:57.473150+0000","last_clean":"2024-04-25T15:30:57.473150+0000","last_became_active":"2024-04-25T15:20:42.422414+0000","last_became_peered":"2024-04-25T15:20:42.422414+0000","last_unstale":"2024-04-25T15:30:57.473150+0000","last_undegraded":"2024-04-25T15:30:57.473150+0000","last_fullsized":"2024-04-25T15:30:57.473150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3287","last_scrub_stamp":"2024-04-25T15:30:53.499840+0000","last_deep_scrub":"41'3287","last_deep_scrub_stamp":"2024-04-25T15:30:53.499840+0000","last_clean_scrub_stamp":"2024-04-25T15:30:53.499840+0000","objects_scrubbed":0,"log_size":3287,"log_dups_size":0,"ondisk_log_size":3287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:53.873868+0000","scrub_duration":3,"objects_trimmed":682,"snaptrim_duration":14.317716965000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1153,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"43'3871","reported_seq":3093,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.478246+0000","last_change":"2024-04-25T15:30:57.478289+0000","last_active":"2024-04-25T15:30:57.478246+0000","last_peered":"2024-04-25T15:30:57.478246+0000","last_clean":"2024-04-25T15:30:57.478246+0000","last_became_active":"2024-04-25T15:20:42.423169+0000","last_became_peered":"2024-04-25T15:20:42.423169+0000","last_unstale":"2024-04-25T15:30:57.478246+0000","last_undegraded":"2024-04-25T15:30:57.478246+0000","last_fullsized":"2024-04-25T15:30:57.478246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3871","last_scrub_stamp":"2024-04-25T15:30:57.478162+0000","last_deep_scrub":"43'3871","last_deep_scrub_stamp":"2024-04-25T15:30:57.478162+0000","last_clean_scrub_stamp":"2024-04-25T15:30:57.478162+0000","objects_scrubbed":1,"log_size":3871,"log_dups_size":0,"ondisk_log_size":3871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:57.852190+0000","scrub_duration":8,"objects_trimmed":736,"snaptrim_duration":13.201060643,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1290,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"42'3126","reported_seq":2530,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.473294+0000","last_change":"2024-04-25T15:30:54.473307+0000","last_active":"2024-04-25T15:30:57.473294+0000","last_peered":"2024-04-25T15:30:57.473294+0000","last_clean":"2024-04-25T15:30:57.473294+0000","last_became_active":"2024-04-25T15:20:42.426805+0000","last_became_peered":"2024-04-25T15:20:42.426805+0000","last_unstale":"2024-04-25T15:30:57.473294+0000","last_undegraded":"2024-04-25T15:30:57.473294+0000","last_fullsized":"2024-04-25T15:30:57.473294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3126","last_scrub_stamp":"2024-04-25T15:30:54.473114+0000","last_deep_scrub":"42'3126","last_deep_scrub_stamp":"2024-04-25T15:30:54.473114+0000","last_clean_scrub_stamp":"2024-04-25T15:30:54.473114+0000","objects_scrubbed":2,"log_size":3126,"log_dups_size":0,"ondisk_log_size":3126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:38.413188+0000","scrub_duration":6,"objects_trimmed":639,"snaptrim_duration":14.31598279,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1144,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"43'3516","reported_seq":2867,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:59.318438+0000","last_change":"2024-04-25T15:30:59.318487+0000","last_active":"2024-04-25T15:30:59.318438+0000","last_peered":"2024-04-25T15:30:59.318438+0000","last_clean":"2024-04-25T15:30:59.318438+0000","last_became_active":"2024-04-25T15:20:42.424717+0000","last_became_peered":"2024-04-25T15:20:42.424717+0000","last_unstale":"2024-04-25T15:30:59.318438+0000","last_undegraded":"2024-04-25T15:30:59.318438+0000","last_fullsized":"2024-04-25T15:30:59.318438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3516","last_scrub_stamp":"2024-04-25T15:30:59.318342+0000","last_deep_scrub":"43'3516","last_deep_scrub_stamp":"2024-04-25T15:30:59.318342+0000","last_clean_scrub_stamp":"2024-04-25T15:30:59.318342+0000","objects_scrubbed":5,"log_size":3516,"log_dups_size":0,"ondisk_log_size":3516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:43.116201+0000","scrub_duration":17,"objects_trimmed":665,"snaptrim_duration":9.2832902970000006,"stat_sum":{"num_bytes":11,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"43'3526","reported_seq":2810,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.981904+0000","last_change":"2024-04-25T15:30:57.981934+0000","last_active":"2024-04-25T15:30:57.981904+0000","last_peered":"2024-04-25T15:30:57.981904+0000","last_clean":"2024-04-25T15:30:57.981904+0000","last_became_active":"2024-04-25T15:20:42.428629+0000","last_became_peered":"2024-04-25T15:20:42.428629+0000","last_unstale":"2024-04-25T15:30:57.981904+0000","last_undegraded":"2024-04-25T15:30:57.981904+0000","last_fullsized":"2024-04-25T15:30:57.981904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3526","last_scrub_stamp":"2024-04-25T15:30:57.981824+0000","last_deep_scrub":"43'3526","last_deep_scrub_stamp":"2024-04-25T15:30:57.981824+0000","last_clean_scrub_stamp":"2024-04-25T15:30:57.981824+0000","objects_scrubbed":2,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:09.443183+0000","scrub_duration":7,"objects_trimmed":676,"snaptrim_duration":10.766965595,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1237,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"42'3299","reported_seq":2644,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.473887+0000","last_change":"2024-04-25T15:30:56.496580+0000","last_active":"2024-04-25T15:30:57.473887+0000","last_peered":"2024-04-25T15:30:57.473887+0000","last_clean":"2024-04-25T15:30:57.473887+0000","last_became_active":"2024-04-25T15:20:42.425374+0000","last_became_peered":"2024-04-25T15:20:42.425374+0000","last_unstale":"2024-04-25T15:30:57.473887+0000","last_undegraded":"2024-04-25T15:30:57.473887+0000","last_fullsized":"2024-04-25T15:30:57.473887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3299","last_scrub_stamp":"2024-04-25T15:30:56.496467+0000","last_deep_scrub":"42'3299","last_deep_scrub_stamp":"2024-04-25T15:30:56.496467+0000","last_clean_scrub_stamp":"2024-04-25T15:30:56.496467+0000","objects_scrubbed":1,"log_size":3299,"log_dups_size":0,"ondisk_log_size":3299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:35.850331+0000","scrub_duration":7,"objects_trimmed":656,"snaptrim_duration":14.318207272,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"42'3449","reported_seq":2773,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638524+0000","last_change":"2024-04-25T15:30:55.729437+0000","last_active":"2024-04-25T15:30:57.638524+0000","last_peered":"2024-04-25T15:30:57.638524+0000","last_clean":"2024-04-25T15:30:57.638524+0000","last_became_active":"2024-04-25T15:20:42.422510+0000","last_became_peered":"2024-04-25T15:20:42.422510+0000","last_unstale":"2024-04-25T15:30:57.638524+0000","last_undegraded":"2024-04-25T15:30:57.638524+0000","last_fullsized":"2024-04-25T15:30:57.638524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3449","last_scrub_stamp":"2024-04-25T15:30:55.729324+0000","last_deep_scrub":"42'3449","last_deep_scrub_stamp":"2024-04-25T15:30:55.729324+0000","last_clean_scrub_stamp":"2024-04-25T15:30:55.729324+0000","objects_scrubbed":1,"log_size":3449,"log_dups_size":0,"ondisk_log_size":3449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:06.325977+0000","scrub_duration":6,"objects_trimmed":729,"snaptrim_duration":14.60360979,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1235,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"42'3139","reported_seq":2523,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.345617+0000","last_change":"2024-04-25T15:30:54.851347+0000","last_active":"2024-04-25T15:30:57.345617+0000","last_peered":"2024-04-25T15:30:57.345617+0000","last_clean":"2024-04-25T15:30:57.345617+0000","last_became_active":"2024-04-25T15:21:23.859850+0000","last_became_peered":"2024-04-25T15:21:23.859850+0000","last_unstale":"2024-04-25T15:30:57.345617+0000","last_undegraded":"2024-04-25T15:30:57.345617+0000","last_fullsized":"2024-04-25T15:30:57.345617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3139","last_scrub_stamp":"2024-04-25T15:30:54.851147+0000","last_deep_scrub":"42'3139","last_deep_scrub_stamp":"2024-04-25T15:30:54.851147+0000","last_clean_scrub_stamp":"2024-04-25T15:30:54.851147+0000","objects_scrubbed":1,"log_size":3139,"log_dups_size":0,"ondisk_log_size":3139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:19.727432+0000","scrub_duration":6,"objects_trimmed":606,"snaptrim_duration":6.6890380110000001,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1119,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"42'4294","reported_seq":3423,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.345492+0000","last_change":"2024-04-25T15:30:52.869394+0000","last_active":"2024-04-25T15:30:57.345492+0000","last_peered":"2024-04-25T15:30:57.345492+0000","last_clean":"2024-04-25T15:30:57.345492+0000","last_became_active":"2024-04-25T15:20:42.430047+0000","last_became_peered":"2024-04-25T15:20:42.430047+0000","last_unstale":"2024-04-25T15:30:57.345492+0000","last_undegraded":"2024-04-25T15:30:57.345492+0000","last_fullsized":"2024-04-25T15:30:57.345492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'4294","last_scrub_stamp":"2024-04-25T15:30:52.869261+0000","last_deep_scrub":"42'4294","last_deep_scrub_stamp":"2024-04-25T15:30:52.869261+0000","last_clean_scrub_stamp":"2024-04-25T15:30:52.869261+0000","objects_scrubbed":2,"log_size":4294,"log_dups_size":0,"ondisk_log_size":4294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:05.314185+0000","scrub_duration":10,"objects_trimmed":828,"snaptrim_duration":6.6887649839999996,"stat_sum":{"num_bytes":9,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1392,"num_write_kb":725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"42'3879","reported_seq":3125,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.350833+0000","last_change":"2024-04-25T15:30:55.330074+0000","last_active":"2024-04-25T15:30:57.350833+0000","last_peered":"2024-04-25T15:30:57.350833+0000","last_clean":"2024-04-25T15:30:57.350833+0000","last_became_active":"2024-04-25T15:20:42.418285+0000","last_became_peered":"2024-04-25T15:20:42.418285+0000","last_unstale":"2024-04-25T15:30:57.350833+0000","last_undegraded":"2024-04-25T15:30:57.350833+0000","last_fullsized":"2024-04-25T15:30:57.350833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3879","last_scrub_stamp":"2024-04-25T15:30:55.329860+0000","last_deep_scrub":"42'3879","last_deep_scrub_stamp":"2024-04-25T15:30:55.329860+0000","last_clean_scrub_stamp":"2024-04-25T15:30:55.329860+0000","objects_scrubbed":4,"log_size":3879,"log_dups_size":0,"ondisk_log_size":3879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:21.487991+0000","scrub_duration":12,"objects_trimmed":743,"snaptrim_duration":9.2833888390000006,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"42'3758","reported_seq":3013,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.346192+0000","last_change":"2024-04-25T15:30:53.382629+0000","last_active":"2024-04-25T15:30:57.346192+0000","last_peered":"2024-04-25T15:30:57.346192+0000","last_clean":"2024-04-25T15:30:57.346192+0000","last_became_active":"2024-04-25T15:20:42.417863+0000","last_became_peered":"2024-04-25T15:20:42.417863+0000","last_unstale":"2024-04-25T15:30:57.346192+0000","last_undegraded":"2024-04-25T15:30:57.346192+0000","last_fullsized":"2024-04-25T15:30:57.346192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3758","last_scrub_stamp":"2024-04-25T15:30:53.382481+0000","last_deep_scrub":"42'3758","last_deep_scrub_stamp":"2024-04-25T15:30:53.382481+0000","last_clean_scrub_stamp":"2024-04-25T15:30:53.382481+0000","objects_scrubbed":1,"log_size":3758,"log_dups_size":0,"ondisk_log_size":3758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:23.413358+0000","scrub_duration":6,"objects_trimmed":718,"snaptrim_duration":8.0786759789999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1232,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"42'3224","reported_seq":3297,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.472960+0000","last_change":"2024-04-25T15:30:49.441495+0000","last_active":"2024-04-25T15:30:57.472960+0000","last_peered":"2024-04-25T15:30:57.472960+0000","last_clean":"2024-04-25T15:30:57.472960+0000","last_became_active":"2024-04-25T15:20:41.411463+0000","last_became_peered":"2024-04-25T15:20:41.411463+0000","last_unstale":"2024-04-25T15:30:57.472960+0000","last_undegraded":"2024-04-25T15:30:57.472960+0000","last_fullsized":"2024-04-25T15:30:57.472960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3224","last_scrub_stamp":"2024-04-25T15:30:49.441291+0000","last_deep_scrub":"42'3224","last_deep_scrub_stamp":"2024-04-25T15:30:49.441291+0000","last_clean_scrub_stamp":"2024-04-25T15:30:49.441291+0000","objects_scrubbed":16,"log_size":3224,"log_dups_size":0,"ondisk_log_size":3224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:00.037943+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":3284,"num_write_kb":9502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":118058,"num_omap_keys":233,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"42'3466","reported_seq":2800,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638567+0000","last_change":"2024-04-25T15:30:49.694205+0000","last_active":"2024-04-25T15:30:57.638567+0000","last_peered":"2024-04-25T15:30:57.638567+0000","last_clean":"2024-04-25T15:30:57.638567+0000","last_became_active":"2024-04-25T15:20:42.412167+0000","last_became_peered":"2024-04-25T15:20:42.412167+0000","last_unstale":"2024-04-25T15:30:57.638567+0000","last_undegraded":"2024-04-25T15:30:57.638567+0000","last_fullsized":"2024-04-25T15:30:57.638567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3466","last_scrub_stamp":"2024-04-25T15:30:49.694090+0000","last_deep_scrub":"42'3466","last_deep_scrub_stamp":"2024-04-25T15:30:49.694090+0000","last_clean_scrub_stamp":"2024-04-25T15:30:49.694090+0000","objects_scrubbed":1,"log_size":3466,"log_dups_size":0,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:53.609626+0000","scrub_duration":6,"objects_trimmed":747,"snaptrim_duration":14.604831302000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1209,"num_write_kb":644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"42'6020","reported_seq":6093,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.351057+0000","last_change":"2024-04-25T15:30:49.382908+0000","last_active":"2024-04-25T15:30:57.351057+0000","last_peered":"2024-04-25T15:30:57.351057+0000","last_clean":"2024-04-25T15:30:57.351057+0000","last_became_active":"2024-04-25T15:20:41.401228+0000","last_became_peered":"2024-04-25T15:20:41.401228+0000","last_unstale":"2024-04-25T15:30:57.351057+0000","last_undegraded":"2024-04-25T15:30:57.351057+0000","last_fullsized":"2024-04-25T15:30:57.351057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'6020","last_scrub_stamp":"2024-04-25T15:30:49.382707+0000","last_deep_scrub":"42'6020","last_deep_scrub_stamp":"2024-04-25T15:30:49.382707+0000","last_clean_scrub_stamp":"2024-04-25T15:30:49.382707+0000","objects_scrubbed":14,"log_size":6020,"log_dups_size":0,"ondisk_log_size":6020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.599971+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":6066,"num_write_kb":31066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82684,"num_omap_keys":164,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"42'894","reported_seq":967,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.472938+0000","last_change":"2024-04-25T15:30:47.415001+0000","last_active":"2024-04-25T15:30:57.472938+0000","last_peered":"2024-04-25T15:30:57.472938+0000","last_clean":"2024-04-25T15:30:57.472938+0000","last_became_active":"2024-04-25T15:20:41.404326+0000","last_became_peered":"2024-04-25T15:20:41.404326+0000","last_unstale":"2024-04-25T15:30:57.472938+0000","last_undegraded":"2024-04-25T15:30:57.472938+0000","last_fullsized":"2024-04-25T15:30:57.472938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'894","last_scrub_stamp":"2024-04-25T15:30:47.414735+0000","last_deep_scrub":"42'894","last_deep_scrub_stamp":"2024-04-25T15:30:47.414735+0000","last_clean_scrub_stamp":"2024-04-25T15:30:47.414735+0000","objects_scrubbed":14,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:10:03.887305+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":944,"num_write_kb":12874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":92564,"num_omap_keys":183,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"42'3840","reported_seq":3061,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.474511+0000","last_change":"2024-04-25T15:30:50.399306+0000","last_active":"2024-04-25T15:30:57.474511+0000","last_peered":"2024-04-25T15:30:57.474511+0000","last_clean":"2024-04-25T15:30:57.474511+0000","last_became_active":"2024-04-25T15:20:42.413442+0000","last_became_peered":"2024-04-25T15:20:42.413442+0000","last_unstale":"2024-04-25T15:30:57.474511+0000","last_undegraded":"2024-04-25T15:30:57.474511+0000","last_fullsized":"2024-04-25T15:30:57.474511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3840","last_scrub_stamp":"2024-04-25T15:30:50.399175+0000","last_deep_scrub":"42'3840","last_deep_scrub_stamp":"2024-04-25T15:30:50.399175+0000","last_clean_scrub_stamp":"2024-04-25T15:30:50.399175+0000","objects_scrubbed":4,"log_size":3840,"log_dups_size":0,"ondisk_log_size":3840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:31.646956+0000","scrub_duration":10,"objects_trimmed":818,"snaptrim_duration":14.316974224999999,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1372,"num_write_kb":721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"42'3138","reported_seq":3211,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.470043+0000","last_change":"2024-04-25T15:30:49.483741+0000","last_active":"2024-04-25T15:30:57.470043+0000","last_peered":"2024-04-25T15:30:57.470043+0000","last_clean":"2024-04-25T15:30:57.470043+0000","last_became_active":"2024-04-25T15:20:41.405883+0000","last_became_peered":"2024-04-25T15:20:41.405883+0000","last_unstale":"2024-04-25T15:30:57.470043+0000","last_undegraded":"2024-04-25T15:30:57.470043+0000","last_fullsized":"2024-04-25T15:30:57.470043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3138","last_scrub_stamp":"2024-04-25T15:30:49.483576+0000","last_deep_scrub":"42'3138","last_deep_scrub_stamp":"2024-04-25T15:30:49.483576+0000","last_clean_scrub_stamp":"2024-04-25T15:30:49.483576+0000","objects_scrubbed":23,"log_size":3138,"log_dups_size":0,"ondisk_log_size":3138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:48.223715+0000","scrub_duration":65,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":3188,"num_write_kb":38703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120444,"num_omap_keys":238,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"42'3654","reported_seq":2972,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638878+0000","last_change":"2024-04-25T15:30:57.015258+0000","last_active":"2024-04-25T15:30:57.638878+0000","last_peered":"2024-04-25T15:30:57.638878+0000","last_clean":"2024-04-25T15:30:57.638878+0000","last_became_active":"2024-04-25T15:20:42.427304+0000","last_became_peered":"2024-04-25T15:20:42.427304+0000","last_unstale":"2024-04-25T15:30:57.638878+0000","last_undegraded":"2024-04-25T15:30:57.638878+0000","last_fullsized":"2024-04-25T15:30:57.638878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3654","last_scrub_stamp":"2024-04-25T15:30:57.015060+0000","last_deep_scrub":"42'3654","last_deep_scrub_stamp":"2024-04-25T15:30:57.015060+0000","last_clean_scrub_stamp":"2024-04-25T15:30:57.015060+0000","objects_scrubbed":3,"log_size":3654,"log_dups_size":0,"ondisk_log_size":3654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:00.188955+0000","scrub_duration":8,"objects_trimmed":658,"snaptrim_duration":10.762374617999999,"stat_sum":{"num_bytes":8192,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"42'1133","reported_seq":1206,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.351778+0000","last_change":"2024-04-25T15:30:51.387684+0000","last_active":"2024-04-25T15:30:57.351778+0000","last_peered":"2024-04-25T15:30:57.351778+0000","last_clean":"2024-04-25T15:30:57.351778+0000","last_became_active":"2024-04-25T15:20:41.405766+0000","last_became_peered":"2024-04-25T15:20:41.405766+0000","last_unstale":"2024-04-25T15:30:57.351778+0000","last_undegraded":"2024-04-25T15:30:57.351778+0000","last_fullsized":"2024-04-25T15:30:57.351778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1133","last_scrub_stamp":"2024-04-25T15:30:51.387397+0000","last_deep_scrub":"42'1133","last_deep_scrub_stamp":"2024-04-25T15:30:51.387397+0000","last_clean_scrub_stamp":"2024-04-25T15:30:51.387397+0000","objects_scrubbed":24,"log_size":1133,"log_dups_size":0,"ondisk_log_size":1133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:17.857105+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1182,"num_write_kb":13307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151058,"num_omap_keys":299,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"43'3346","reported_seq":2728,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:58.995967+0000","last_change":"2024-04-25T15:30:58.995967+0000","last_active":"2024-04-25T15:30:58.995967+0000","last_peered":"2024-04-25T15:30:58.995967+0000","last_clean":"2024-04-25T15:30:58.995967+0000","last_became_active":"2024-04-25T15:21:23.536519+0000","last_became_peered":"2024-04-25T15:21:23.536519+0000","last_unstale":"2024-04-25T15:30:58.995967+0000","last_undegraded":"2024-04-25T15:30:58.995967+0000","last_fullsized":"2024-04-25T15:30:58.995967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3346","last_scrub_stamp":"2024-04-25T15:30:58.995858+0000","last_deep_scrub":"43'3346","last_deep_scrub_stamp":"2024-04-25T15:30:58.995858+0000","last_clean_scrub_stamp":"2024-04-25T15:30:58.995858+0000","objects_scrubbed":2,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:44:11.351865+0000","scrub_duration":9,"objects_trimmed":659,"snaptrim_duration":10.764864054,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1183,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"42'1824","reported_seq":1897,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.470108+0000","last_change":"2024-04-25T15:30:51.434100+0000","last_active":"2024-04-25T15:30:57.470108+0000","last_peered":"2024-04-25T15:30:57.470108+0000","last_clean":"2024-04-25T15:30:57.470108+0000","last_became_active":"2024-04-25T15:20:41.409980+0000","last_became_peered":"2024-04-25T15:20:41.409980+0000","last_unstale":"2024-04-25T15:30:57.470108+0000","last_undegraded":"2024-04-25T15:30:57.470108+0000","last_fullsized":"2024-04-25T15:30:57.470108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1824","last_scrub_stamp":"2024-04-25T15:30:51.433926+0000","last_deep_scrub":"42'1824","last_deep_scrub_stamp":"2024-04-25T15:30:51.433926+0000","last_clean_scrub_stamp":"2024-04-25T15:30:51.433926+0000","objects_scrubbed":11,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:47:53.501235+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1874,"num_write_kb":25731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":53760,"num_omap_keys":106,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"42'3554","reported_seq":2861,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.639093+0000","last_change":"2024-04-25T15:30:56.769842+0000","last_active":"2024-04-25T15:30:57.639093+0000","last_peered":"2024-04-25T15:30:57.639093+0000","last_clean":"2024-04-25T15:30:57.639093+0000","last_became_active":"2024-04-25T15:20:42.422320+0000","last_became_peered":"2024-04-25T15:20:42.422320+0000","last_unstale":"2024-04-25T15:30:57.639093+0000","last_undegraded":"2024-04-25T15:30:57.639093+0000","last_fullsized":"2024-04-25T15:30:57.639093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3554","last_scrub_stamp":"2024-04-25T15:30:56.769724+0000","last_deep_scrub":"42'3554","last_deep_scrub_stamp":"2024-04-25T15:30:56.769724+0000","last_clean_scrub_stamp":"2024-04-25T15:30:56.769724+0000","objects_scrubbed":2,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:10.540271+0000","scrub_duration":8,"objects_trimmed":712,"snaptrim_duration":14.601408788000001,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":1199,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"42'3274","reported_seq":3347,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.640122+0000","last_change":"2024-04-25T15:30:52.100156+0000","last_active":"2024-04-25T15:30:57.640122+0000","last_peered":"2024-04-25T15:30:57.640122+0000","last_clean":"2024-04-25T15:30:57.640122+0000","last_became_active":"2024-04-25T15:20:41.415659+0000","last_became_peered":"2024-04-25T15:20:41.415659+0000","last_unstale":"2024-04-25T15:30:57.640122+0000","last_undegraded":"2024-04-25T15:30:57.640122+0000","last_fullsized":"2024-04-25T15:30:57.640122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3274","last_scrub_stamp":"2024-04-25T15:30:52.100041+0000","last_deep_scrub":"42'3274","last_deep_scrub_stamp":"2024-04-25T15:30:52.100041+0000","last_clean_scrub_stamp":"2024-04-25T15:30:52.100041+0000","objects_scrubbed":26,"log_size":3274,"log_dups_size":0,"ondisk_log_size":3274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:17.075443+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3319,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":177112,"num_omap_keys":345,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'3965","reported_seq":3192,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.348682+0000","last_change":"2024-04-25T15:30:52.414510+0000","last_active":"2024-04-25T15:30:57.348682+0000","last_peered":"2024-04-25T15:30:57.348682+0000","last_clean":"2024-04-25T15:30:57.348682+0000","last_became_active":"2024-04-25T15:20:42.415148+0000","last_became_peered":"2024-04-25T15:20:42.415148+0000","last_unstale":"2024-04-25T15:30:57.348682+0000","last_undegraded":"2024-04-25T15:30:57.348682+0000","last_fullsized":"2024-04-25T15:30:57.348682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3965","last_scrub_stamp":"2024-04-25T15:30:52.414344+0000","last_deep_scrub":"41'3965","last_deep_scrub_stamp":"2024-04-25T15:30:52.414344+0000","last_clean_scrub_stamp":"2024-04-25T15:30:52.414344+0000","objects_scrubbed":0,"log_size":3965,"log_dups_size":0,"ondisk_log_size":3965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:38.033277+0000","scrub_duration":5,"objects_trimmed":757,"snaptrim_duration":8.0786606909999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1251,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"42'5299","reported_seq":5373,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.351222+0000","last_change":"2024-04-25T15:30:52.352070+0000","last_active":"2024-04-25T15:30:57.351222+0000","last_peered":"2024-04-25T15:30:57.351222+0000","last_clean":"2024-04-25T15:30:57.351222+0000","last_became_active":"2024-04-25T15:20:41.406417+0000","last_became_peered":"2024-04-25T15:20:41.406417+0000","last_unstale":"2024-04-25T15:30:57.351222+0000","last_undegraded":"2024-04-25T15:30:57.351222+0000","last_fullsized":"2024-04-25T15:30:57.351222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'5299","last_scrub_stamp":"2024-04-25T15:30:52.351873+0000","last_deep_scrub":"42'5299","last_deep_scrub_stamp":"2024-04-25T15:30:52.351873+0000","last_clean_scrub_stamp":"2024-04-25T15:30:52.351873+0000","objects_scrubbed":25,"log_size":5299,"log_dups_size":0,"ondisk_log_size":5299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:41.381689+0000","scrub_duration":66,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":5332,"num_write_kb":30677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111412,"num_omap_keys":221,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"43'3638","reported_seq":2921,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:07.199356+0000","last_change":"2024-04-25T15:31:07.199396+0000","last_active":"2024-04-25T15:31:07.199356+0000","last_peered":"2024-04-25T15:31:07.199356+0000","last_clean":"2024-04-25T15:31:07.199356+0000","last_became_active":"2024-04-25T15:20:42.422867+0000","last_became_peered":"2024-04-25T15:20:42.422867+0000","last_unstale":"2024-04-25T15:31:07.199356+0000","last_undegraded":"2024-04-25T15:31:07.199356+0000","last_fullsized":"2024-04-25T15:31:07.199356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3638","last_scrub_stamp":"2024-04-25T15:31:07.199258+0000","last_deep_scrub":"43'3638","last_deep_scrub_stamp":"2024-04-25T15:31:07.199258+0000","last_clean_scrub_stamp":"2024-04-25T15:31:07.199258+0000","objects_scrubbed":2,"log_size":3638,"log_dups_size":0,"ondisk_log_size":3638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:20.087015+0000","scrub_duration":8,"objects_trimmed":714,"snaptrim_duration":13.460606116999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1214,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"41'2626","reported_seq":2700,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.637143+0000","last_change":"2024-04-25T15:30:46.658285+0000","last_active":"2024-04-25T15:30:57.637143+0000","last_peered":"2024-04-25T15:30:57.637143+0000","last_clean":"2024-04-25T15:30:57.637143+0000","last_became_active":"2024-04-25T15:20:41.401384+0000","last_became_peered":"2024-04-25T15:20:41.401384+0000","last_unstale":"2024-04-25T15:30:57.637143+0000","last_undegraded":"2024-04-25T15:30:57.637143+0000","last_fullsized":"2024-04-25T15:30:57.637143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2626","last_scrub_stamp":"2024-04-25T15:30:46.658159+0000","last_deep_scrub":"41'2626","last_deep_scrub_stamp":"2024-04-25T15:30:46.658159+0000","last_clean_scrub_stamp":"2024-04-25T15:30:46.658159+0000","objects_scrubbed":25,"log_size":2626,"log_dups_size":0,"ondisk_log_size":2626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:17.530339+0000","scrub_duration":62,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":2688,"num_write_kb":17973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":166058,"num_omap_keys":329,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"42'3293","reported_seq":2651,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638462+0000","last_change":"2024-04-25T15:30:52.744367+0000","last_active":"2024-04-25T15:30:57.638462+0000","last_peered":"2024-04-25T15:30:57.638462+0000","last_clean":"2024-04-25T15:30:57.638462+0000","last_became_active":"2024-04-25T15:20:42.416082+0000","last_became_peered":"2024-04-25T15:20:42.416082+0000","last_unstale":"2024-04-25T15:30:57.638462+0000","last_undegraded":"2024-04-25T15:30:57.638462+0000","last_fullsized":"2024-04-25T15:30:57.638462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3293","last_scrub_stamp":"2024-04-25T15:30:52.744210+0000","last_deep_scrub":"42'3293","last_deep_scrub_stamp":"2024-04-25T15:30:52.744210+0000","last_clean_scrub_stamp":"2024-04-25T15:30:52.744210+0000","objects_scrubbed":2,"log_size":3293,"log_dups_size":0,"ondisk_log_size":3293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:49.432970+0000","scrub_duration":8,"objects_trimmed":688,"snaptrim_duration":14.602412889,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":1228,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"42'123","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.470609+0000","last_change":"2024-04-25T15:30:50.441717+0000","last_active":"2024-04-25T15:30:57.470609+0000","last_peered":"2024-04-25T15:30:57.470609+0000","last_clean":"2024-04-25T15:30:57.470609+0000","last_became_active":"2024-04-25T15:20:41.408861+0000","last_became_peered":"2024-04-25T15:20:41.408861+0000","last_unstale":"2024-04-25T15:30:57.470609+0000","last_undegraded":"2024-04-25T15:30:57.470609+0000","last_fullsized":"2024-04-25T15:30:57.470609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'123","last_scrub_stamp":"2024-04-25T15:30:50.441596+0000","last_deep_scrub":"42'123","last_deep_scrub_stamp":"2024-04-25T15:30:50.441596+0000","last_clean_scrub_stamp":"2024-04-25T15:30:50.441596+0000","objects_scrubbed":12,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:47.130356+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":196,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":95140,"num_omap_keys":188,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"43'4122","reported_seq":3358,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:59.273149+0000","last_change":"2024-04-25T15:30:59.273262+0000","last_active":"2024-04-25T15:30:59.273149+0000","last_peered":"2024-04-25T15:30:59.273149+0000","last_clean":"2024-04-25T15:30:59.273149+0000","last_became_active":"2024-04-25T15:20:42.412065+0000","last_became_peered":"2024-04-25T15:20:42.412065+0000","last_unstale":"2024-04-25T15:30:59.273149+0000","last_undegraded":"2024-04-25T15:30:59.273149+0000","last_fullsized":"2024-04-25T15:30:59.273149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'4122","last_scrub_stamp":"2024-04-25T15:30:59.273030+0000","last_deep_scrub":"43'4122","last_deep_scrub_stamp":"2024-04-25T15:30:59.273030+0000","last_clean_scrub_stamp":"2024-04-25T15:30:59.273030+0000","objects_scrubbed":3,"log_size":4122,"log_dups_size":0,"ondisk_log_size":4122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:58:59.832753+0000","scrub_duration":13,"objects_trimmed":756,"snaptrim_duration":13.463338272,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1302,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"42'1092","reported_seq":1165,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.350885+0000","last_change":"2024-04-25T15:30:50.396241+0000","last_active":"2024-04-25T15:30:57.350885+0000","last_peered":"2024-04-25T15:30:57.350885+0000","last_clean":"2024-04-25T15:30:57.350885+0000","last_became_active":"2024-04-25T15:20:41.401554+0000","last_became_peered":"2024-04-25T15:20:41.401554+0000","last_unstale":"2024-04-25T15:30:57.350885+0000","last_undegraded":"2024-04-25T15:30:57.350885+0000","last_fullsized":"2024-04-25T15:30:57.350885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1092","last_scrub_stamp":"2024-04-25T15:30:50.396079+0000","last_deep_scrub":"42'1092","last_deep_scrub_stamp":"2024-04-25T15:30:50.396079+0000","last_clean_scrub_stamp":"2024-04-25T15:30:50.396079+0000","objects_scrubbed":18,"log_size":1092,"log_dups_size":0,"ondisk_log_size":1092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:51.989482+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1158,"num_write_kb":5155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":127058,"num_omap_keys":251,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"41'3501","reported_seq":2799,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.350991+0000","last_change":"2024-04-25T15:30:54.309402+0000","last_active":"2024-04-25T15:30:57.350991+0000","last_peered":"2024-04-25T15:30:57.350991+0000","last_clean":"2024-04-25T15:30:57.350991+0000","last_became_active":"2024-04-25T15:20:42.417915+0000","last_became_peered":"2024-04-25T15:20:42.417915+0000","last_unstale":"2024-04-25T15:30:57.350991+0000","last_undegraded":"2024-04-25T15:30:57.350991+0000","last_fullsized":"2024-04-25T15:30:57.350991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3501","last_scrub_stamp":"2024-04-25T15:30:54.309198+0000","last_deep_scrub":"41'3501","last_deep_scrub_stamp":"2024-04-25T15:30:54.309198+0000","last_clean_scrub_stamp":"2024-04-25T15:30:54.309198+0000","objects_scrubbed":0,"log_size":3501,"log_dups_size":0,"ondisk_log_size":3501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:19.284600+0000","scrub_duration":5,"objects_trimmed":671,"snaptrim_duration":9.9325539109999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1227,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"42'1043","reported_seq":1116,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.345363+0000","last_change":"2024-04-25T15:30:50.849935+0000","last_active":"2024-04-25T15:30:57.345363+0000","last_peered":"2024-04-25T15:30:57.345363+0000","last_clean":"2024-04-25T15:30:57.345363+0000","last_became_active":"2024-04-25T15:20:41.408062+0000","last_became_peered":"2024-04-25T15:20:41.408062+0000","last_unstale":"2024-04-25T15:30:57.345363+0000","last_undegraded":"2024-04-25T15:30:57.345363+0000","last_fullsized":"2024-04-25T15:30:57.345363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1043","last_scrub_stamp":"2024-04-25T15:30:50.849804+0000","last_deep_scrub":"42'1043","last_deep_scrub_stamp":"2024-04-25T15:30:50.849804+0000","last_clean_scrub_stamp":"2024-04-25T15:30:50.849804+0000","objects_scrubbed":28,"log_size":1043,"log_dups_size":0,"ondisk_log_size":1043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:37:34.487699+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":1107,"num_write_kb":8933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":187153,"num_omap_keys":368,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"43'3479","reported_seq":2785,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:01.262205+0000","last_change":"2024-04-25T15:31:01.262246+0000","last_active":"2024-04-25T15:31:01.262205+0000","last_peered":"2024-04-25T15:31:01.262205+0000","last_clean":"2024-04-25T15:31:01.262205+0000","last_became_active":"2024-04-25T15:20:42.415149+0000","last_became_peered":"2024-04-25T15:20:42.415149+0000","last_unstale":"2024-04-25T15:31:01.262205+0000","last_undegraded":"2024-04-25T15:31:01.262205+0000","last_fullsized":"2024-04-25T15:31:01.262205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3479","last_scrub_stamp":"2024-04-25T15:31:01.262098+0000","last_deep_scrub":"43'3479","last_deep_scrub_stamp":"2024-04-25T15:31:01.262098+0000","last_clean_scrub_stamp":"2024-04-25T15:31:01.262098+0000","objects_scrubbed":3,"log_size":3479,"log_dups_size":0,"ondisk_log_size":3479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:02.364011+0000","scrub_duration":11,"objects_trimmed":708,"snaptrim_duration":13.462787312,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1271,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"42'1323","reported_seq":1396,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.348061+0000","last_change":"2024-04-25T15:30:48.304590+0000","last_active":"2024-04-25T15:30:57.348061+0000","last_peered":"2024-04-25T15:30:57.348061+0000","last_clean":"2024-04-25T15:30:57.348061+0000","last_became_active":"2024-04-25T15:20:41.405200+0000","last_became_peered":"2024-04-25T15:20:41.405200+0000","last_unstale":"2024-04-25T15:30:57.348061+0000","last_undegraded":"2024-04-25T15:30:57.348061+0000","last_fullsized":"2024-04-25T15:30:57.348061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1323","last_scrub_stamp":"2024-04-25T15:30:48.304454+0000","last_deep_scrub":"42'1323","last_deep_scrub_stamp":"2024-04-25T15:30:48.304454+0000","last_clean_scrub_stamp":"2024-04-25T15:30:48.304454+0000","objects_scrubbed":18,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:00:59.081701+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":1351,"num_write_kb":8728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":118102,"num_omap_keys":234,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"42'3640","reported_seq":2889,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.347376+0000","last_change":"2024-04-25T15:30:51.311315+0000","last_active":"2024-04-25T15:30:57.347376+0000","last_peered":"2024-04-25T15:30:57.347376+0000","last_clean":"2024-04-25T15:30:57.347376+0000","last_became_active":"2024-04-25T15:20:42.411838+0000","last_became_peered":"2024-04-25T15:20:42.411838+0000","last_unstale":"2024-04-25T15:30:57.347376+0000","last_undegraded":"2024-04-25T15:30:57.347376+0000","last_fullsized":"2024-04-25T15:30:57.347376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3640","last_scrub_stamp":"2024-04-25T15:30:51.311168+0000","last_deep_scrub":"42'3640","last_deep_scrub_stamp":"2024-04-25T15:30:51.311168+0000","last_clean_scrub_stamp":"2024-04-25T15:30:51.311168+0000","objects_scrubbed":3,"log_size":3640,"log_dups_size":0,"ondisk_log_size":3640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:35.251243+0000","scrub_duration":10,"objects_trimmed":736,"snaptrim_duration":13.465097034999999,"stat_sum":{"num_bytes":14,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"42'2494","reported_seq":2566,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.345801+0000","last_change":"2024-04-25T15:30:49.851747+0000","last_active":"2024-04-25T15:30:57.345801+0000","last_peered":"2024-04-25T15:30:57.345801+0000","last_clean":"2024-04-25T15:30:57.345801+0000","last_became_active":"2024-04-25T15:20:41.406474+0000","last_became_peered":"2024-04-25T15:20:41.406474+0000","last_unstale":"2024-04-25T15:30:57.345801+0000","last_undegraded":"2024-04-25T15:30:57.345801+0000","last_fullsized":"2024-04-25T15:30:57.345801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2494","last_scrub_stamp":"2024-04-25T15:30:49.851604+0000","last_deep_scrub":"42'2494","last_deep_scrub_stamp":"2024-04-25T15:30:49.851604+0000","last_clean_scrub_stamp":"2024-04-25T15:30:49.851604+0000","objects_scrubbed":20,"log_size":2494,"log_dups_size":0,"ondisk_log_size":2494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:32:26.603124+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":2548,"num_write_kb":13580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":127140,"num_omap_keys":252,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"43'3460","reported_seq":2811,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:00.256552+0000","last_change":"2024-04-25T15:31:00.256604+0000","last_active":"2024-04-25T15:31:00.256552+0000","last_peered":"2024-04-25T15:31:00.256552+0000","last_clean":"2024-04-25T15:31:00.256552+0000","last_became_active":"2024-04-25T15:20:42.413899+0000","last_became_peered":"2024-04-25T15:20:42.413899+0000","last_unstale":"2024-04-25T15:31:00.256552+0000","last_undegraded":"2024-04-25T15:31:00.256552+0000","last_fullsized":"2024-04-25T15:31:00.256552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3460","last_scrub_stamp":"2024-04-25T15:31:00.256445+0000","last_deep_scrub":"43'3460","last_deep_scrub_stamp":"2024-04-25T15:31:00.256445+0000","last_clean_scrub_stamp":"2024-04-25T15:31:00.256445+0000","objects_scrubbed":5,"log_size":3460,"log_dups_size":0,"ondisk_log_size":3460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:26.802354+0000","scrub_duration":15,"objects_trimmed":712,"snaptrim_duration":13.655509435999999,"stat_sum":{"num_bytes":4117,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1224,"num_write_kb":639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"42'4468","reported_seq":4541,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.639574+0000","last_change":"2024-04-25T15:30:49.150021+0000","last_active":"2024-04-25T15:30:57.639574+0000","last_peered":"2024-04-25T15:30:57.639574+0000","last_clean":"2024-04-25T15:30:57.639574+0000","last_became_active":"2024-04-25T15:20:41.410232+0000","last_became_peered":"2024-04-25T15:20:41.410232+0000","last_unstale":"2024-04-25T15:30:57.639574+0000","last_undegraded":"2024-04-25T15:30:57.639574+0000","last_fullsized":"2024-04-25T15:30:57.639574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'4468","last_scrub_stamp":"2024-04-25T15:30:49.149865+0000","last_deep_scrub":"42'4468","last_deep_scrub_stamp":"2024-04-25T15:30:49.149865+0000","last_clean_scrub_stamp":"2024-04-25T15:30:49.149865+0000","objects_scrubbed":26,"log_size":4468,"log_dups_size":0,"ondisk_log_size":4468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:15.619573+0000","scrub_duration":69,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583135,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":4527,"num_write_kb":26836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":159286,"num_omap_keys":315,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"43'3541","reported_seq":2852,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:01.419449+0000","last_change":"2024-04-25T15:31:01.419510+0000","last_active":"2024-04-25T15:31:01.419449+0000","last_peered":"2024-04-25T15:31:01.419449+0000","last_clean":"2024-04-25T15:31:01.419449+0000","last_became_active":"2024-04-25T15:21:23.537569+0000","last_became_peered":"2024-04-25T15:21:23.537569+0000","last_unstale":"2024-04-25T15:31:01.419449+0000","last_undegraded":"2024-04-25T15:31:01.419449+0000","last_fullsized":"2024-04-25T15:31:01.419449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3541","last_scrub_stamp":"2024-04-25T15:31:01.419306+0000","last_deep_scrub":"43'3541","last_deep_scrub_stamp":"2024-04-25T15:31:01.419306+0000","last_clean_scrub_stamp":"2024-04-25T15:31:01.419306+0000","objects_scrubbed":2,"log_size":3541,"log_dups_size":0,"ondisk_log_size":3541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:59:19.353032+0000","scrub_duration":8,"objects_trimmed":722,"snaptrim_duration":13.203520253000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"42'2098","reported_seq":2171,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.345612+0000","last_change":"2024-04-25T15:30:47.811291+0000","last_active":"2024-04-25T15:30:57.345612+0000","last_peered":"2024-04-25T15:30:57.345612+0000","last_clean":"2024-04-25T15:30:57.345612+0000","last_became_active":"2024-04-25T15:20:41.403674+0000","last_became_peered":"2024-04-25T15:20:41.403674+0000","last_unstale":"2024-04-25T15:30:57.345612+0000","last_undegraded":"2024-04-25T15:30:57.345612+0000","last_fullsized":"2024-04-25T15:30:57.345612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2098","last_scrub_stamp":"2024-04-25T15:30:47.811080+0000","last_deep_scrub":"42'2098","last_deep_scrub_stamp":"2024-04-25T15:30:47.811080+0000","last_clean_scrub_stamp":"2024-04-25T15:30:47.811080+0000","objects_scrubbed":25,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:44.086095+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":2143,"num_write_kb":17826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":157863,"num_omap_keys":312,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'3515","reported_seq":2816,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:06.166706+0000","last_change":"2024-04-25T15:31:06.166754+0000","last_active":"2024-04-25T15:31:06.166706+0000","last_peered":"2024-04-25T15:31:06.166706+0000","last_clean":"2024-04-25T15:31:06.166706+0000","last_became_active":"2024-04-25T15:20:42.421981+0000","last_became_peered":"2024-04-25T15:20:42.421981+0000","last_unstale":"2024-04-25T15:31:06.166706+0000","last_undegraded":"2024-04-25T15:31:06.166706+0000","last_fullsized":"2024-04-25T15:31:06.166706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3515","last_scrub_stamp":"2024-04-25T15:31:06.166578+0000","last_deep_scrub":"43'3515","last_deep_scrub_stamp":"2024-04-25T15:31:06.166578+0000","last_clean_scrub_stamp":"2024-04-25T15:31:06.166578+0000","objects_scrubbed":1,"log_size":3515,"log_dups_size":0,"ondisk_log_size":3515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:19:18.911478+0000","scrub_duration":6,"objects_trimmed":702,"snaptrim_duration":13.462059612999999,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1171,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"42'74","reported_seq":172,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.348980+0000","last_change":"2024-04-25T15:30:52.326275+0000","last_active":"2024-04-25T15:30:57.348980+0000","last_peered":"2024-04-25T15:30:57.348980+0000","last_clean":"2024-04-25T15:30:57.348980+0000","last_became_active":"2024-04-25T15:20:30.872053+0000","last_became_peered":"2024-04-25T15:20:30.872053+0000","last_unstale":"2024-04-25T15:30:57.348980+0000","last_undegraded":"2024-04-25T15:30:57.348980+0000","last_fullsized":"2024-04-25T15:30:57.348980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'74","last_scrub_stamp":"2024-04-25T15:30:52.326071+0000","last_deep_scrub":"42'74","last_deep_scrub_stamp":"2024-04-25T15:30:52.326071+0000","last_clean_scrub_stamp":"2024-04-25T15:30:52.326071+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:15:27.764419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"42'1192","reported_seq":1266,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.470122+0000","last_change":"2024-04-25T15:30:48.470528+0000","last_active":"2024-04-25T15:30:57.470122+0000","last_peered":"2024-04-25T15:30:57.470122+0000","last_clean":"2024-04-25T15:30:57.470122+0000","last_became_active":"2024-04-25T15:20:41.403583+0000","last_became_peered":"2024-04-25T15:20:41.403583+0000","last_unstale":"2024-04-25T15:30:57.470122+0000","last_undegraded":"2024-04-25T15:30:57.470122+0000","last_fullsized":"2024-04-25T15:30:57.470122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1192","last_scrub_stamp":"2024-04-25T15:30:48.470385+0000","last_deep_scrub":"42'1192","last_deep_scrub_stamp":"2024-04-25T15:30:48.470385+0000","last_clean_scrub_stamp":"2024-04-25T15:30:48.470385+0000","objects_scrubbed":21,"log_size":1192,"log_dups_size":0,"ondisk_log_size":1192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:40.827275+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":1252,"num_write_kb":13357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":116639,"num_omap_keys":231,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"43'3491","reported_seq":2842,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:31:00.537645+0000","last_change":"2024-04-25T15:31:00.537709+0000","last_active":"2024-04-25T15:31:00.537645+0000","last_peered":"2024-04-25T15:31:00.537645+0000","last_clean":"2024-04-25T15:31:00.537645+0000","last_became_active":"2024-04-25T15:20:42.432390+0000","last_became_peered":"2024-04-25T15:20:42.432390+0000","last_unstale":"2024-04-25T15:31:00.537645+0000","last_undegraded":"2024-04-25T15:31:00.537645+0000","last_fullsized":"2024-04-25T15:31:00.537645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3491","last_scrub_stamp":"2024-04-25T15:31:00.537538+0000","last_deep_scrub":"43'3491","last_deep_scrub_stamp":"2024-04-25T15:31:00.537538+0000","last_clean_scrub_stamp":"2024-04-25T15:31:00.537538+0000","objects_scrubbed":1,"log_size":3491,"log_dups_size":0,"ondisk_log_size":3491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:01:54.971551+0000","scrub_duration":7,"objects_trimmed":697,"snaptrim_duration":14.715070064000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"43'3636","reported_seq":3710,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:58.349300+0000","last_change":"2024-04-25T15:30:58.349400+0000","last_active":"2024-04-25T15:30:58.349300+0000","last_peered":"2024-04-25T15:30:58.349300+0000","last_clean":"2024-04-25T15:30:58.349300+0000","last_became_active":"2024-04-25T15:20:41.410214+0000","last_became_peered":"2024-04-25T15:20:41.410214+0000","last_unstale":"2024-04-25T15:30:58.349300+0000","last_undegraded":"2024-04-25T15:30:58.349300+0000","last_fullsized":"2024-04-25T15:30:58.349300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3636","last_scrub_stamp":"2024-04-25T15:30:58.349174+0000","last_deep_scrub":"43'3636","last_deep_scrub_stamp":"2024-04-25T15:30:58.349174+0000","last_clean_scrub_stamp":"2024-04-25T15:30:58.349174+0000","objects_scrubbed":22,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:09.255757+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6520497,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":3670,"num_write_kb":20386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":151938,"num_omap_keys":300,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"41'3586","reported_seq":2863,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.637742+0000","last_change":"2024-04-25T15:30:48.667542+0000","last_active":"2024-04-25T15:30:57.637742+0000","last_peered":"2024-04-25T15:30:57.637742+0000","last_clean":"2024-04-25T15:30:57.637742+0000","last_became_active":"2024-04-25T15:20:42.410088+0000","last_became_peered":"2024-04-25T15:20:42.410088+0000","last_unstale":"2024-04-25T15:30:57.637742+0000","last_undegraded":"2024-04-25T15:30:57.637742+0000","last_fullsized":"2024-04-25T15:30:57.637742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3586","last_scrub_stamp":"2024-04-25T15:30:48.667347+0000","last_deep_scrub":"41'3586","last_deep_scrub_stamp":"2024-04-25T15:30:48.667347+0000","last_clean_scrub_stamp":"2024-04-25T15:30:48.667347+0000","objects_scrubbed":0,"log_size":3586,"log_dups_size":0,"ondisk_log_size":3586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:26.113195+0000","scrub_duration":4,"objects_trimmed":698,"snaptrim_duration":14.601195101,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1168,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"42'2387","reported_seq":2774,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.345554+0000","last_change":"2024-04-25T15:30:48.817258+0000","last_active":"2024-04-25T15:30:57.345554+0000","last_peered":"2024-04-25T15:30:57.345554+0000","last_clean":"2024-04-25T15:30:57.345554+0000","last_became_active":"2024-04-25T15:20:41.405707+0000","last_became_peered":"2024-04-25T15:20:41.405707+0000","last_unstale":"2024-04-25T15:30:57.345554+0000","last_undegraded":"2024-04-25T15:30:57.345554+0000","last_fullsized":"2024-04-25T15:30:57.345554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2387","last_scrub_stamp":"2024-04-25T15:30:48.817115+0000","last_deep_scrub":"42'2387","last_deep_scrub_stamp":"2024-04-25T15:30:48.817115+0000","last_clean_scrub_stamp":"2024-04-25T15:30:48.817115+0000","objects_scrubbed":14,"log_size":2387,"log_dups_size":0,"ondisk_log_size":2387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:39.618450+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11691863,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":329,"num_read_kb":3430,"num_write":2430,"num_write_kb":16848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":84912,"num_omap_keys":168,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"42'3416","reported_seq":2752,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638128+0000","last_change":"2024-04-25T15:30:56.056154+0000","last_active":"2024-04-25T15:30:57.638128+0000","last_peered":"2024-04-25T15:30:57.638128+0000","last_clean":"2024-04-25T15:30:57.638128+0000","last_became_active":"2024-04-25T15:20:42.419118+0000","last_became_peered":"2024-04-25T15:20:42.419118+0000","last_unstale":"2024-04-25T15:30:57.638128+0000","last_undegraded":"2024-04-25T15:30:57.638128+0000","last_fullsized":"2024-04-25T15:30:57.638128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3416","last_scrub_stamp":"2024-04-25T15:30:56.055944+0000","last_deep_scrub":"42'3416","last_deep_scrub_stamp":"2024-04-25T15:30:56.055944+0000","last_clean_scrub_stamp":"2024-04-25T15:30:56.055944+0000","objects_scrubbed":3,"log_size":3416,"log_dups_size":0,"ondisk_log_size":3416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:28.967351+0000","scrub_duration":8,"objects_trimmed":723,"snaptrim_duration":10.760873258,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1246,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"42'6798","reported_seq":6872,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.470820+0000","last_change":"2024-04-25T15:30:52.488513+0000","last_active":"2024-04-25T15:30:57.470820+0000","last_peered":"2024-04-25T15:30:57.470820+0000","last_clean":"2024-04-25T15:30:57.470820+0000","last_became_active":"2024-04-25T15:20:41.410347+0000","last_became_peered":"2024-04-25T15:20:41.410347+0000","last_unstale":"2024-04-25T15:30:57.470820+0000","last_undegraded":"2024-04-25T15:30:57.470820+0000","last_fullsized":"2024-04-25T15:30:57.470820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'6798","last_scrub_stamp":"2024-04-25T15:30:52.488362+0000","last_deep_scrub":"42'6798","last_deep_scrub_stamp":"2024-04-25T15:30:52.488362+0000","last_clean_scrub_stamp":"2024-04-25T15:30:52.488362+0000","objects_scrubbed":17,"log_size":6798,"log_dups_size":0,"ondisk_log_size":6798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:45.563142+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":6828,"num_write_kb":32500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":81669,"num_omap_keys":161,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"42'3647","reported_seq":2904,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.348534+0000","last_change":"2024-04-25T15:30:49.339795+0000","last_active":"2024-04-25T15:30:57.348534+0000","last_peered":"2024-04-25T15:30:57.348534+0000","last_clean":"2024-04-25T15:30:57.348534+0000","last_became_active":"2024-04-25T15:20:42.406037+0000","last_became_peered":"2024-04-25T15:20:42.406037+0000","last_unstale":"2024-04-25T15:30:57.348534+0000","last_undegraded":"2024-04-25T15:30:57.348534+0000","last_fullsized":"2024-04-25T15:30:57.348534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3647","last_scrub_stamp":"2024-04-25T15:30:49.339588+0000","last_deep_scrub":"42'3647","last_deep_scrub_stamp":"2024-04-25T15:30:49.339588+0000","last_clean_scrub_stamp":"2024-04-25T15:30:49.339588+0000","objects_scrubbed":6,"log_size":3647,"log_dups_size":0,"ondisk_log_size":3647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:14.215873+0000","scrub_duration":15,"objects_trimmed":737,"snaptrim_duration":8.0788980660000007,"stat_sum":{"num_bytes":21,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1263,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"42'162","reported_seq":235,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638587+0000","last_change":"2024-04-25T15:30:51.030709+0000","last_active":"2024-04-25T15:30:57.638587+0000","last_peered":"2024-04-25T15:30:57.638587+0000","last_clean":"2024-04-25T15:30:57.638587+0000","last_became_active":"2024-04-25T15:20:41.413331+0000","last_became_peered":"2024-04-25T15:20:41.413331+0000","last_unstale":"2024-04-25T15:30:57.638587+0000","last_undegraded":"2024-04-25T15:30:57.638587+0000","last_fullsized":"2024-04-25T15:30:57.638587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'162","last_scrub_stamp":"2024-04-25T15:30:51.030564+0000","last_deep_scrub":"42'162","last_deep_scrub_stamp":"2024-04-25T15:30:51.030564+0000","last_clean_scrub_stamp":"2024-04-25T15:30:51.030564+0000","objects_scrubbed":18,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:16.637801+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":208,"num_write_kb":8700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99672,"num_omap_keys":196,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"42'3252","reported_seq":2632,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.471004+0000","last_change":"2024-04-25T15:30:56.450183+0000","last_active":"2024-04-25T15:30:57.471004+0000","last_peered":"2024-04-25T15:30:57.471004+0000","last_clean":"2024-04-25T15:30:57.471004+0000","last_became_active":"2024-04-25T15:20:42.423093+0000","last_became_peered":"2024-04-25T15:20:42.423093+0000","last_unstale":"2024-04-25T15:30:57.471004+0000","last_undegraded":"2024-04-25T15:30:57.471004+0000","last_fullsized":"2024-04-25T15:30:57.471004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3252","last_scrub_stamp":"2024-04-25T15:30:56.449996+0000","last_deep_scrub":"42'3252","last_deep_scrub_stamp":"2024-04-25T15:30:56.449996+0000","last_clean_scrub_stamp":"2024-04-25T15:30:56.449996+0000","objects_scrubbed":5,"log_size":3252,"log_dups_size":0,"ondisk_log_size":3252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:18.590050+0000","scrub_duration":11,"objects_trimmed":659,"snaptrim_duration":13.203930687,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1164,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"42'1992","reported_seq":2066,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.363920+0000","last_change":"2024-04-25T15:30:56.334020+0000","last_active":"2024-04-25T15:30:57.363920+0000","last_peered":"2024-04-25T15:30:57.363920+0000","last_clean":"2024-04-25T15:30:57.363920+0000","last_became_active":"2024-04-25T15:20:41.408475+0000","last_became_peered":"2024-04-25T15:20:41.408475+0000","last_unstale":"2024-04-25T15:30:57.363920+0000","last_undegraded":"2024-04-25T15:30:57.363920+0000","last_fullsized":"2024-04-25T15:30:57.363920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1992","last_scrub_stamp":"2024-04-25T15:30:56.333796+0000","last_deep_scrub":"42'1992","last_deep_scrub_stamp":"2024-04-25T15:30:56.333796+0000","last_clean_scrub_stamp":"2024-04-25T15:30:56.333796+0000","objects_scrubbed":19,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:48.974618+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2030,"num_write_kb":21675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":109026,"num_omap_keys":216,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"42'3472","reported_seq":2805,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638401+0000","last_change":"2024-04-25T15:30:55.074219+0000","last_active":"2024-04-25T15:30:57.638401+0000","last_peered":"2024-04-25T15:30:57.638401+0000","last_clean":"2024-04-25T15:30:57.638401+0000","last_became_active":"2024-04-25T15:20:42.418532+0000","last_became_peered":"2024-04-25T15:20:42.418532+0000","last_unstale":"2024-04-25T15:30:57.638401+0000","last_undegraded":"2024-04-25T15:30:57.638401+0000","last_fullsized":"2024-04-25T15:30:57.638401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3472","last_scrub_stamp":"2024-04-25T15:30:55.074021+0000","last_deep_scrub":"42'3472","last_deep_scrub_stamp":"2024-04-25T15:30:55.074021+0000","last_clean_scrub_stamp":"2024-04-25T15:30:55.074021+0000","objects_scrubbed":2,"log_size":3472,"log_dups_size":0,"ondisk_log_size":3472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:10:10.795495+0000","scrub_duration":7,"objects_trimmed":690,"snaptrim_duration":10.764830177,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1200,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"42'2519","reported_seq":2591,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.637919+0000","last_change":"2024-04-25T15:30:48.146779+0000","last_active":"2024-04-25T15:30:57.637919+0000","last_peered":"2024-04-25T15:30:57.637919+0000","last_clean":"2024-04-25T15:30:57.637919+0000","last_became_active":"2024-04-25T15:20:41.408318+0000","last_became_peered":"2024-04-25T15:20:41.408318+0000","last_unstale":"2024-04-25T15:30:57.637919+0000","last_undegraded":"2024-04-25T15:30:57.637919+0000","last_fullsized":"2024-04-25T15:30:57.637919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2519","last_scrub_stamp":"2024-04-25T15:30:48.146623+0000","last_deep_scrub":"42'2519","last_deep_scrub_stamp":"2024-04-25T15:30:48.146623+0000","last_clean_scrub_stamp":"2024-04-25T15:30:48.146623+0000","objects_scrubbed":17,"log_size":2519,"log_dups_size":0,"ondisk_log_size":2519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:07:55.141135+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":3243,"num_write_kb":16596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":98640,"num_omap_keys":195,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"43'3549","reported_seq":2886,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.492801+0000","last_change":"2024-04-25T15:30:57.492849+0000","last_active":"2024-04-25T15:30:57.492801+0000","last_peered":"2024-04-25T15:30:57.492801+0000","last_clean":"2024-04-25T15:30:57.492801+0000","last_became_active":"2024-04-25T15:20:42.428072+0000","last_became_peered":"2024-04-25T15:20:42.428072+0000","last_unstale":"2024-04-25T15:30:57.492801+0000","last_undegraded":"2024-04-25T15:30:57.492801+0000","last_fullsized":"2024-04-25T15:30:57.492801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3549","last_scrub_stamp":"2024-04-25T15:30:57.492675+0000","last_deep_scrub":"43'3549","last_deep_scrub_stamp":"2024-04-25T15:30:57.492675+0000","last_clean_scrub_stamp":"2024-04-25T15:30:57.492675+0000","objects_scrubbed":1,"log_size":3549,"log_dups_size":0,"ondisk_log_size":3549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:13.560697+0000","scrub_duration":6,"objects_trimmed":717,"snaptrim_duration":14.318725012,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"42'156","reported_seq":229,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.351962+0000","last_change":"2024-04-25T15:30:53.340023+0000","last_active":"2024-04-25T15:30:57.351962+0000","last_peered":"2024-04-25T15:30:57.351962+0000","last_clean":"2024-04-25T15:30:57.351962+0000","last_became_active":"2024-04-25T15:20:41.410625+0000","last_became_peered":"2024-04-25T15:20:41.410625+0000","last_unstale":"2024-04-25T15:30:57.351962+0000","last_undegraded":"2024-04-25T15:30:57.351962+0000","last_fullsized":"2024-04-25T15:30:57.351962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'156","last_scrub_stamp":"2024-04-25T15:30:53.339777+0000","last_deep_scrub":"42'156","last_deep_scrub_stamp":"2024-04-25T15:30:53.339777+0000","last_clean_scrub_stamp":"2024-04-25T15:30:53.339777+0000","objects_scrubbed":23,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:32.696246+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":213,"num_write_kb":8722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":155476,"num_omap_keys":307,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"41'3272","reported_seq":2650,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.638646+0000","last_change":"2024-04-25T15:30:50.688137+0000","last_active":"2024-04-25T15:30:57.638646+0000","last_peered":"2024-04-25T15:30:57.638646+0000","last_clean":"2024-04-25T15:30:57.638646+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:57.638646+0000","last_undegraded":"2024-04-25T15:30:57.638646+0000","last_fullsized":"2024-04-25T15:30:57.638646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3272","last_scrub_stamp":"2024-04-25T15:30:50.688021+0000","last_deep_scrub":"41'3272","last_deep_scrub_stamp":"2024-04-25T15:30:50.688021+0000","last_clean_scrub_stamp":"2024-04-25T15:30:50.688021+0000","objects_scrubbed":0,"log_size":3272,"log_dups_size":0,"ondisk_log_size":3272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:03:23.820943+0000","scrub_duration":3,"objects_trimmed":654,"snaptrim_duration":14.603761489,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"42'1055","reported_seq":1128,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.346087+0000","last_change":"2024-04-25T15:30:53.313789+0000","last_active":"2024-04-25T15:30:57.346087+0000","last_peered":"2024-04-25T15:30:57.346087+0000","last_clean":"2024-04-25T15:30:57.346087+0000","last_became_active":"2024-04-25T15:20:41.404540+0000","last_became_peered":"2024-04-25T15:20:41.404540+0000","last_unstale":"2024-04-25T15:30:57.346087+0000","last_undegraded":"2024-04-25T15:30:57.346087+0000","last_fullsized":"2024-04-25T15:30:57.346087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1055","last_scrub_stamp":"2024-04-25T15:30:53.313570+0000","last_deep_scrub":"42'1055","last_deep_scrub_stamp":"2024-04-25T15:30:53.313570+0000","last_clean_scrub_stamp":"2024-04-25T15:30:53.313570+0000","objects_scrubbed":19,"log_size":1055,"log_dups_size":0,"ondisk_log_size":1055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:29:36.248689+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":1104,"num_write_kb":9199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":137710,"num_omap_keys":272,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"42'3355","reported_seq":2667,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.347027+0000","last_change":"2024-04-25T15:30:51.376382+0000","last_active":"2024-04-25T15:30:57.347027+0000","last_peered":"2024-04-25T15:30:57.347027+0000","last_clean":"2024-04-25T15:30:57.347027+0000","last_became_active":"2024-04-25T15:20:42.413106+0000","last_became_peered":"2024-04-25T15:20:42.413106+0000","last_unstale":"2024-04-25T15:30:57.347027+0000","last_undegraded":"2024-04-25T15:30:57.347027+0000","last_fullsized":"2024-04-25T15:30:57.347027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3355","last_scrub_stamp":"2024-04-25T15:30:51.376198+0000","last_deep_scrub":"42'3355","last_deep_scrub_stamp":"2024-04-25T15:30:51.376198+0000","last_clean_scrub_stamp":"2024-04-25T15:30:51.376198+0000","objects_scrubbed":3,"log_size":3355,"log_dups_size":0,"ondisk_log_size":3355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:41:27.953638+0000","scrub_duration":10,"objects_trimmed":673,"snaptrim_duration":8.5715076529999994,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1203,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"42'1888","reported_seq":1960,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.637715+0000","last_change":"2024-04-25T15:30:50.097485+0000","last_active":"2024-04-25T15:30:57.637715+0000","last_peered":"2024-04-25T15:30:57.637715+0000","last_clean":"2024-04-25T15:30:57.637715+0000","last_became_active":"2024-04-25T15:20:41.411399+0000","last_became_peered":"2024-04-25T15:20:41.411399+0000","last_unstale":"2024-04-25T15:30:57.637715+0000","last_undegraded":"2024-04-25T15:30:57.637715+0000","last_fullsized":"2024-04-25T15:30:57.637715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1888","last_scrub_stamp":"2024-04-25T15:30:50.097294+0000","last_deep_scrub":"42'1888","last_deep_scrub_stamp":"2024-04-25T15:30:50.097294+0000","last_clean_scrub_stamp":"2024-04-25T15:30:50.097294+0000","objects_scrubbed":10,"log_size":1888,"log_dups_size":0,"ondisk_log_size":1888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:58:39.127110+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":1954,"num_write_kb":17506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":48570,"num_omap_keys":96,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"42'3434","reported_seq":2767,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.474656+0000","last_change":"2024-04-25T15:30:51.428076+0000","last_active":"2024-04-25T15:30:57.474656+0000","last_peered":"2024-04-25T15:30:57.474656+0000","last_clean":"2024-04-25T15:30:57.474656+0000","last_became_active":"2024-04-25T15:20:42.417094+0000","last_became_peered":"2024-04-25T15:20:42.417094+0000","last_unstale":"2024-04-25T15:30:57.474656+0000","last_undegraded":"2024-04-25T15:30:57.474656+0000","last_fullsized":"2024-04-25T15:30:57.474656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3434","last_scrub_stamp":"2024-04-25T15:30:51.427950+0000","last_deep_scrub":"42'3434","last_deep_scrub_stamp":"2024-04-25T15:30:51.427950+0000","last_clean_scrub_stamp":"2024-04-25T15:30:51.427950+0000","objects_scrubbed":1,"log_size":3434,"log_dups_size":0,"ondisk_log_size":3434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:44.137090+0000","scrub_duration":7,"objects_trimmed":712,"snaptrim_duration":14.317761206,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1258,"num_write_kb":646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'3670","reported_seq":3742,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.640060+0000","last_change":"2024-04-25T15:30:47.137794+0000","last_active":"2024-04-25T15:30:57.640060+0000","last_peered":"2024-04-25T15:30:57.640060+0000","last_clean":"2024-04-25T15:30:57.640060+0000","last_became_active":"2024-04-25T15:20:41.406594+0000","last_became_peered":"2024-04-25T15:20:41.406594+0000","last_unstale":"2024-04-25T15:30:57.640060+0000","last_undegraded":"2024-04-25T15:30:57.640060+0000","last_fullsized":"2024-04-25T15:30:57.640060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'3670","last_scrub_stamp":"2024-04-25T15:30:47.137627+0000","last_deep_scrub":"41'3670","last_deep_scrub_stamp":"2024-04-25T15:30:47.137627+0000","last_clean_scrub_stamp":"2024-04-25T15:30:47.137627+0000","objects_scrubbed":19,"log_size":3670,"log_dups_size":0,"ondisk_log_size":3670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:14.723431+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":3718,"num_write_kb":26255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121564,"num_omap_keys":241,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"42'3150","reported_seq":2563,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.473720+0000","last_change":"2024-04-25T15:30:52.462364+0000","last_active":"2024-04-25T15:30:57.473720+0000","last_peered":"2024-04-25T15:30:57.473720+0000","last_clean":"2024-04-25T15:30:57.473720+0000","last_became_active":"2024-04-25T15:20:42.422130+0000","last_became_peered":"2024-04-25T15:20:42.422130+0000","last_unstale":"2024-04-25T15:30:57.473720+0000","last_undegraded":"2024-04-25T15:30:57.473720+0000","last_fullsized":"2024-04-25T15:30:57.473720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3150","last_scrub_stamp":"2024-04-25T15:30:52.462197+0000","last_deep_scrub":"42'3150","last_deep_scrub_stamp":"2024-04-25T15:30:52.462197+0000","last_clean_scrub_stamp":"2024-04-25T15:30:52.462197+0000","objects_scrubbed":2,"log_size":3150,"log_dups_size":0,"ondisk_log_size":3150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:14.602251+0000","scrub_duration":7,"objects_trimmed":627,"snaptrim_duration":14.316786818000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"42'5249","reported_seq":5322,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.346988+0000","last_change":"2024-04-25T15:30:54.385357+0000","last_active":"2024-04-25T15:30:57.346988+0000","last_peered":"2024-04-25T15:30:57.346988+0000","last_clean":"2024-04-25T15:30:57.346988+0000","last_became_active":"2024-04-25T15:20:41.407732+0000","last_became_peered":"2024-04-25T15:20:41.407732+0000","last_unstale":"2024-04-25T15:30:57.346988+0000","last_undegraded":"2024-04-25T15:30:57.346988+0000","last_fullsized":"2024-04-25T15:30:57.346988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'5249","last_scrub_stamp":"2024-04-25T15:30:54.385144+0000","last_deep_scrub":"42'5249","last_deep_scrub_stamp":"2024-04-25T15:30:54.385144+0000","last_clean_scrub_stamp":"2024-04-25T15:30:54.385144+0000","objects_scrubbed":23,"log_size":5249,"log_dups_size":0,"ondisk_log_size":5249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:02:10.453166+0000","scrub_duration":78,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":5301,"num_write_kb":30551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":121807,"num_omap_keys":241,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"43'3713","reported_seq":2965,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:58.358606+0000","last_change":"2024-04-25T15:30:58.358663+0000","last_active":"2024-04-25T15:30:58.358606+0000","last_peered":"2024-04-25T15:30:58.358606+0000","last_clean":"2024-04-25T15:30:58.358606+0000","last_became_active":"2024-04-25T15:20:42.421578+0000","last_became_peered":"2024-04-25T15:20:42.421578+0000","last_unstale":"2024-04-25T15:30:58.358606+0000","last_undegraded":"2024-04-25T15:30:58.358606+0000","last_fullsized":"2024-04-25T15:30:58.358606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3713","last_scrub_stamp":"2024-04-25T15:30:58.358481+0000","last_deep_scrub":"43'3713","last_deep_scrub_stamp":"2024-04-25T15:30:58.358481+0000","last_clean_scrub_stamp":"2024-04-25T15:30:58.358481+0000","objects_scrubbed":3,"log_size":3713,"log_dups_size":0,"ondisk_log_size":3713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.412239+0000","scrub_duration":9,"objects_trimmed":693,"snaptrim_duration":9.2817127389999996,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"42'3357","reported_seq":2753,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.471005+0000","last_change":"2024-04-25T15:30:53.448948+0000","last_active":"2024-04-25T15:30:57.471005+0000","last_peered":"2024-04-25T15:30:57.471005+0000","last_clean":"2024-04-25T15:30:57.471005+0000","last_became_active":"2024-04-25T15:20:42.420999+0000","last_became_peered":"2024-04-25T15:20:42.420999+0000","last_unstale":"2024-04-25T15:30:57.471005+0000","last_undegraded":"2024-04-25T15:30:57.471005+0000","last_fullsized":"2024-04-25T15:30:57.471005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3357","last_scrub_stamp":"2024-04-25T15:30:53.448777+0000","last_deep_scrub":"42'3357","last_deep_scrub_stamp":"2024-04-25T15:30:53.448777+0000","last_clean_scrub_stamp":"2024-04-25T15:30:53.448777+0000","objects_scrubbed":8,"log_size":3357,"log_dups_size":0,"ondisk_log_size":3357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:09:04.045430+0000","scrub_duration":16,"objects_trimmed":668,"snaptrim_duration":13.202123224999999,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":1184,"num_write_kb":614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"42'1142","reported_seq":1215,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.346153+0000","last_change":"2024-04-25T15:30:55.310093+0000","last_active":"2024-04-25T15:30:57.346153+0000","last_peered":"2024-04-25T15:30:57.346153+0000","last_clean":"2024-04-25T15:30:57.346153+0000","last_became_active":"2024-04-25T15:20:41.408174+0000","last_became_peered":"2024-04-25T15:20:41.408174+0000","last_unstale":"2024-04-25T15:30:57.346153+0000","last_undegraded":"2024-04-25T15:30:57.346153+0000","last_fullsized":"2024-04-25T15:30:57.346153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'1142","last_scrub_stamp":"2024-04-25T15:30:55.309868+0000","last_deep_scrub":"42'1142","last_deep_scrub_stamp":"2024-04-25T15:30:55.309868+0000","last_clean_scrub_stamp":"2024-04-25T15:30:55.309868+0000","objects_scrubbed":15,"log_size":1142,"log_dups_size":0,"ondisk_log_size":1142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:04.038761+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":1211,"num_write_kb":4844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":108140,"num_omap_keys":214,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"42'3805","reported_seq":3053,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.471083+0000","last_change":"2024-04-25T15:30:54.468550+0000","last_active":"2024-04-25T15:30:57.471083+0000","last_peered":"2024-04-25T15:30:57.471083+0000","last_clean":"2024-04-25T15:30:57.471083+0000","last_became_active":"2024-04-25T15:20:42.421232+0000","last_became_peered":"2024-04-25T15:20:42.421232+0000","last_unstale":"2024-04-25T15:30:57.471083+0000","last_undegraded":"2024-04-25T15:30:57.471083+0000","last_fullsized":"2024-04-25T15:30:57.471083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'3805","last_scrub_stamp":"2024-04-25T15:30:54.468395+0000","last_deep_scrub":"42'3805","last_deep_scrub_stamp":"2024-04-25T15:30:54.468395+0000","last_clean_scrub_stamp":"2024-04-25T15:30:54.468395+0000","objects_scrubbed":2,"log_size":3805,"log_dups_size":0,"ondisk_log_size":3805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.716176+0000","scrub_duration":8,"objects_trimmed":823,"snaptrim_duration":13.204368401,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1350,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"42'8182","reported_seq":8255,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.369600+0000","last_change":"2024-04-25T15:30:57.369714+0000","last_active":"2024-04-25T15:30:57.369600+0000","last_peered":"2024-04-25T15:30:57.369600+0000","last_clean":"2024-04-25T15:30:57.369600+0000","last_became_active":"2024-04-25T15:20:41.408584+0000","last_became_peered":"2024-04-25T15:20:41.408584+0000","last_unstale":"2024-04-25T15:30:57.369600+0000","last_undegraded":"2024-04-25T15:30:57.369600+0000","last_fullsized":"2024-04-25T15:30:57.369600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'8182","last_scrub_stamp":"2024-04-25T15:30:57.369498+0000","last_deep_scrub":"42'8182","last_deep_scrub_stamp":"2024-04-25T15:30:57.369498+0000","last_clean_scrub_stamp":"2024-04-25T15:30:57.369498+0000","objects_scrubbed":22,"log_size":8182,"log_dups_size":0,"ondisk_log_size":8182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:50.875587+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":8233,"num_write_kb":32021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":141075,"num_omap_keys":272,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"43'3260","reported_seq":2645,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.805007+0000","last_change":"2024-04-25T15:30:57.805007+0000","last_active":"2024-04-25T15:30:57.805007+0000","last_peered":"2024-04-25T15:30:57.805007+0000","last_clean":"2024-04-25T15:30:57.805007+0000","last_became_active":"2024-04-25T15:20:42.422757+0000","last_became_peered":"2024-04-25T15:20:42.422757+0000","last_unstale":"2024-04-25T15:30:57.805007+0000","last_undegraded":"2024-04-25T15:30:57.805007+0000","last_fullsized":"2024-04-25T15:30:57.805007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3260","last_scrub_stamp":"2024-04-25T15:30:57.804903+0000","last_deep_scrub":"43'3260","last_deep_scrub_stamp":"2024-04-25T15:30:57.804903+0000","last_clean_scrub_stamp":"2024-04-25T15:30:57.804903+0000","objects_scrubbed":1,"log_size":3260,"log_dups_size":0,"ondisk_log_size":3260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:50.514043+0000","scrub_duration":4,"objects_trimmed":669,"snaptrim_duration":14.600214884,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1094,"num_write_kb":575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"42'6137","reported_seq":6211,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.473779+0000","last_change":"2024-04-25T15:30:48.513501+0000","last_active":"2024-04-25T15:30:57.473779+0000","last_peered":"2024-04-25T15:30:57.473779+0000","last_clean":"2024-04-25T15:30:57.473779+0000","last_became_active":"2024-04-25T15:20:41.405588+0000","last_became_peered":"2024-04-25T15:20:41.405588+0000","last_unstale":"2024-04-25T15:30:57.473779+0000","last_undegraded":"2024-04-25T15:30:57.473779+0000","last_fullsized":"2024-04-25T15:30:57.473779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'6137","last_scrub_stamp":"2024-04-25T15:30:48.513278+0000","last_deep_scrub":"42'6137","last_deep_scrub_stamp":"2024-04-25T15:30:48.513278+0000","last_clean_scrub_stamp":"2024-04-25T15:30:48.513278+0000","objects_scrubbed":16,"log_size":6137,"log_dups_size":0,"ondisk_log_size":6137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:41.588058+0000","scrub_duration":97,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":6190,"num_write_kb":31064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99792,"num_omap_keys":197,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"43'3452","reported_seq":2771,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:58.476868+0000","last_change":"2024-04-25T15:30:58.476898+0000","last_active":"2024-04-25T15:30:58.476868+0000","last_peered":"2024-04-25T15:30:58.476868+0000","last_clean":"2024-04-25T15:30:58.476868+0000","last_became_active":"2024-04-25T15:20:42.429015+0000","last_became_peered":"2024-04-25T15:20:42.429015+0000","last_unstale":"2024-04-25T15:30:58.476868+0000","last_undegraded":"2024-04-25T15:30:58.476868+0000","last_fullsized":"2024-04-25T15:30:58.476868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'3452","last_scrub_stamp":"2024-04-25T15:30:58.476777+0000","last_deep_scrub":"43'3452","last_deep_scrub_stamp":"2024-04-25T15:30:58.476777+0000","last_clean_scrub_stamp":"2024-04-25T15:30:58.476777+0000","objects_scrubbed":1,"log_size":3452,"log_dups_size":0,"ondisk_log_size":3452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:50:07.205671+0000","scrub_duration":6,"objects_trimmed":662,"snaptrim_duration":14.316401759,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"42'2551","reported_seq":2625,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T15:30:57.637267+0000","last_change":"2024-04-25T15:30:47.654305+0000","last_active":"2024-04-25T15:30:57.637267+0000","last_peered":"2024-04-25T15:30:57.637267+0000","last_clean":"2024-04-25T15:30:57.637267+0000","last_became_active":"2024-04-25T15:20:41.410411+0000","last_became_peered":"2024-04-25T15:20:41.410411+0000","last_unstale":"2024-04-25T15:30:57.637267+0000","last_undegraded":"2024-04-25T15:30:57.637267+0000","last_fullsized":"2024-04-25T15:30:57.637267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'2551","last_scrub_stamp":"2024-04-25T15:30:47.654080+0000","last_deep_scrub":"42'2551","last_deep_scrub_stamp":"2024-04-25T15:30:47.654080+0000","last_clean_scrub_stamp":"2024-04-25T15:30:47.654080+0000","objects_scrubbed":14,"log_size":2551,"log_dups_size":0,"ondisk_log_size":2551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:44:41.378199+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":2610,"num_write_kb":9414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153158,"num_omap_keys":304,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":127343,"num_objects":147,"num_object_clones":20,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":12,"num_read":44,"num_read_kb":30,"num_write":77732,"num_write_kb":40597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":254492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224593,"ondisk_log_size":224593,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":265677919,"num_objects":614,"num_object_clones":0,"num_object_copies":1228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":614,"num_whiteouts":0,"num_read":835,"num_read_kb":3430,"num_write":91102,"num_write_kb":583108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":542,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3874680,"num_omap_keys":7649,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":531415040,"data_stored":531355838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88789,"ondisk_log_size":88789,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":416724,"kb_used_data":64844,"kb_used_omap":1,"kb_used_meta":351870,"kb_avail":93955116,"statfs":{"total":96636764160,"available":96210038784,"internally_reserved":0,"allocated":66400256,"data_stored":66092801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":360315338},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574980,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380176,"kb_used_data":82440,"kb_used_omap":1,"kb_used_meta":297726,"kb_avail":93991664,"statfs":{"total":96636764160,"available":96247463936,"internally_reserved":0,"allocated":84418560,"data_stored":84127290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":304871878},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574979,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374628,"kb_used_data":82460,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93997212,"statfs":{"total":96636764160,"available":96253145088,"internally_reserved":0,"allocated":84439040,"data_stored":84147218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":299170246},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574979,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":412444,"kb_used_data":61972,"kb_used_omap":1,"kb_used_meta":350462,"kb_avail":93959396,"statfs":{"total":96636764160,"available":96214421504,"internally_reserved":0,"allocated":63459328,"data_stored":63155401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":358873542},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":375308,"kb_used_data":69316,"kb_used_omap":1,"kb_used_meta":305982,"kb_avail":93996532,"statfs":{"total":96636764160,"available":96252448768,"internally_reserved":0,"allocated":70979584,"data_stored":70682017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":313326023},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574981,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193948,"kb_used_data":36500,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94177892,"statfs":{"total":96636764160,"available":96438161408,"internally_reserved":0,"allocated":37376000,"data_stored":37094100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":408800,"kb_used_data":84692,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":93963040,"statfs":{"total":96636764160,"available":96218152960,"internally_reserved":0,"allocated":86724608,"data_stored":86444880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":331872709},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574980,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311968,"kb_used_data":42072,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":94059872,"statfs":{"total":96636764160,"available":96317308928,"internally_reserved":0,"allocated":43081728,"data_stored":42774639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41955328,"data_stored":41943678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86220800,"data_stored":86212586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36859904,"data_stored":36857687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":70422528,"data_stored":70412791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62926848,"data_stored":62914839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":83890176,"data_stored":83886170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83894272,"data_stored":83886752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65245184,"data_stored":65241335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":24683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":16384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":53316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":24652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":45138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":24628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":45188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T15:31:10.028 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T15:31:10.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.171+0000 7fa747508640 1 Processor -- start 2024-04-25T15:31:10.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.171+0000 7fa747508640 1 -- start start 2024-04-25T15:31:10.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa747508640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa74009e180 0x7fa74009caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa747508640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7400a11e0 con 0x7fa74009c690 2024-04-25T15:31:10.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa747508640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74014d9a0 con 0x7fa74014d130 2024-04-25T15:31:10.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa747508640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa74009d550 con 0x7fa74009e180 2024-04-25T15:31:10.176 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa744aa3640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa74009c690 0x7fa74009da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47560/0 (socket says 172.21.15.33:47560) 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa744aa3640 1 -- 172.21.15.33:0/1517773393 learned_addr learned my addr 172.21.15.33:0/1517773393 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa745aa5640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa74009e180 0x7fa74009caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059463876 0 0) 0x7fa7400a11e0 con 0x7fa74009c690 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.172+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa72c003520 con 0x7fa74009c690 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 552297145 0 0) 0x7fa72c003520 con 0x7fa74009c690 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa74009e180 msgr2=0x7fa74009caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa74009e180 0x7fa74009caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 >> v1:172.21.15.155:6789/0 conn(0x7fa74014d130 legacy=0x7fa7400a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74014d540 con 0x7fa74009c690 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7fa730001670 con 0x7fa74009c690 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 >> v1:172.21.15.33:6789/0 conn(0x7fa74009c690 legacy=0x7fa74009da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c0039e0 0x7fa72c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c004350 0x7fa72c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa72c005030 0x7fa72c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa74009d550 con 0x7fa72c004350 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c00bfb0 con 0x7fa72c005030 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa72c00c1b0 con 0x7fa72c0039e0 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa744aa3640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c004350 0x7fa72c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa7452a4640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c0039e0 0x7fa72c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa745aa5640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa72c005030 0x7fa72c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa744aa3640 1 -- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c0039e0 msgr2=0x7fa72c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa744aa3640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c0039e0 0x7fa72c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa744aa3640 1 -- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa72c005030 msgr2=0x7fa72c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa744aa3640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa72c005030 0x7fa72c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.173+0000 7fa744aa3640 1 -- 172.21.15.33:0/1517773393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c003520 con 0x7fa72c004350 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.174+0000 7fa744aa3640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c004350 0x7fa72c004880 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c190 tx=0x7fa72c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c703b5367060ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.174+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730007cc0 con 0x7fa72c004350 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.174+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa730005ad0 con 0x7fa72c004350 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.174+0000 7fa737fff640 1 -- 172.21.15.33:0/1517773393 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730007070 con 0x7fa72c004350 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.175+0000 7fa747508640 1 -- 172.21.15.33:0/1517773393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c004350 msgr2=0x7fa72c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.175+0000 7fa747508640 1 --2- 172.21.15.33:0/1517773393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c004350 0x7fa72c004880 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c190 tx=0x7fa72c005830 comp rx=0 tx=0).stop 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.175+0000 7fa745aa5640 1 -- 172.21.15.33:0/1517773393 reap_dead start 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.175+0000 7fa747508640 1 -- 172.21.15.33:0/1517773393 shutdown_connections 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.175+0000 7fa747508640 1 -- 172.21.15.33:0/1517773393 >> 172.21.15.33:0/1517773393 conn(0x7fa7400bb5f0 msgr2=0x7fa7400bba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.175+0000 7fa747508640 1 -- 172.21.15.33:0/1517773393 shutdown_connections 2024-04-25T15:31:10.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.175+0000 7fa747508640 1 -- 172.21.15.33:0/1517773393 wait complete. 2024-04-25T15:31:10.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.176+0000 7fa747508640 1 Processor -- start 2024-04-25T15:31:10.181 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.176+0000 7fa747508640 1 -- start start 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.177+0000 7fa747508640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c004350 0x7fa7400a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.177+0000 7fa747508640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7401e2670 0x7fa7400b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.177+0000 7fa747508640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa740146a40 0x7fa740146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.177+0000 7fa747508640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fa74014d710 con 0x7fa7401e2670 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.177+0000 7fa747508640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa74009e390 con 0x7fa740146a40 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.177+0000 7fa747508640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa74009caa0 con 0x7fa72c004350 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7401e2670 0x7fa7400b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7401e2670 0x7fa7400b8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40142/0 (socket says 172.21.15.33:40142) 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 -- 172.21.15.33:0/879826614 learned_addr learned my addr 172.21.15.33:0/879826614 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa7452a4640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c004350 0x7fa7400a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa745aa5640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa740146a40 0x7fa740146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 -- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c004350 msgr2=0x7fa7400a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c004350 0x7fa7400a3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 -- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa740146a40 msgr2=0x7fa740146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa740146a40 0x7fa740146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 -- 172.21.15.33:0/879826614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7400b8950 con 0x7fa7401e2670 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa745aa5640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa740146a40 0x7fa740146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa744aa3640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7401e2670 0x7fa7400b8410 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7fa73002acf0 tx=0x7fa7300019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa735ffb640 1 -- 172.21.15.33:0/879826614 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730001630 con 0x7fa7401e2670 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa735ffb640 1 -- 172.21.15.33:0/879826614 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa730042070 con 0x7fa7401e2670 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7401e2e20 con 0x7fa7401e2670 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.178+0000 7fa735ffb640 1 -- 172.21.15.33:0/879826614 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7300072b0 con 0x7fa7401e2670 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.179+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7400b7b30 con 0x7fa7401e2670 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.180+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74009eb20 con 0x7fa7401e2670 2024-04-25T15:31:10.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.180+0000 7fa735ffb640 1 -- 172.21.15.33:0/879826614 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa730007450 con 0x7fa7401e2670 2024-04-25T15:31:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.181+0000 7fa735ffb640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7240744b0 0x7fa7240769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.181+0000 7fa735ffb640 1 -- 172.21.15.33:0/879826614 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5896+0+0 (secure 0 0 0) 0x7fa7300b5820 con 0x7fa7401e2670 2024-04-25T15:31:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.181+0000 7fa7452a4640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7240744b0 0x7fa7240769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.184 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.182+0000 7fa7452a4640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7240744b0 0x7fa7240769c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa74009f010 tx=0x7fa73c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.187 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.186+0000 7fa735ffb640 1 -- 172.21.15.33:0/879826614 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa74009eb20 con 0x7fa7401e2670 2024-04-25T15:31:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.373+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa7400764e0 con 0x7fa7401e2670 2024-04-25T15:31:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.377+0000 7fa735ffb640 1 -- 172.21.15.33:0/879826614 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fa730005aa0 con 0x7fa7401e2670 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa735ffb640 1 -- 172.21.15.33:0/879826614 <== mon.0 v2:172.21.15.33:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa730038040 con 0x7fa7401e2670 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7240744b0 msgr2=0x7fa7240769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7240744b0 0x7fa7240769c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa74009f010 tx=0x7fa73c009040 comp rx=0 tx=0).stop 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7401e2670 msgr2=0x7fa7400b8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7401e2670 0x7fa7400b8410 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7fa73002acf0 tx=0x7fa7300019c0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 shutdown_connections 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fa7240744b0 0x7fa7240769c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa740146a40 0x7fa740146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7401e2670 0x7fa7400b8410 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 --2- 172.21.15.33:0/879826614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa72c004350 0x7fa7400a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 >> 172.21.15.33:0/879826614 conn(0x7fa7400bb5f0 msgr2=0x7fa740075ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:10.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 shutdown_connections 2024-04-25T15:31:10.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.379+0000 7fa747508640 1 -- 172.21.15.33:0/879826614 wait complete. 2024-04-25T15:31:10.392 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T15:31:10.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:31:10.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.503+0000 7efde0984640 1 Processor -- start 2024-04-25T15:31:10.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.503+0000 7efde0984640 1 -- start start 2024-04-25T15:31:10.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efde0984640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efddc06f320 0x7efddc070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efde0984640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efddc0a2870 con 0x7efddc06dbc0 2024-04-25T15:31:10.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efde0984640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efddc06ee90 con 0x7efddc06dfd0 2024-04-25T15:31:10.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efde0984640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efddc06f730 con 0x7efddc06f320 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efdd9d9b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7efddc06dbc0 0x7efddc149e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47562/0 (socket says 172.21.15.33:47562) 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efdd9d9b640 1 -- 172.21.15.33:0/3264990608 learned_addr learned my addr 172.21.15.33:0/3264990608 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285539055 0 0) 0x7efddc0a2870 con 0x7efddc06dbc0 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efdda59c640 1 --2- 172.21.15.33:0/3264990608 >> v2:172.21.15.155:3300/0 conn(0x7efddc06f320 0x7efddc070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.504+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdc4003520 con 0x7efddc06dbc0 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1721809928 0 0) 0x7efdc4003520 con 0x7efddc06dbc0 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 >> v2:172.21.15.155:3300/0 conn(0x7efddc06f320 msgr2=0x7efddc070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 --2- 172.21.15.33:0/3264990608 >> v2:172.21.15.155:3300/0 conn(0x7efddc06f320 0x7efddc070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 >> v1:172.21.15.155:6789/0 conn(0x7efddc06dfd0 legacy=0x7efddc1541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc0a22b0 con 0x7efddc06dbc0 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2759009553 0 0) 0x7efdd0001670 con 0x7efddc06dbc0 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 >> v1:172.21.15.33:6789/0 conn(0x7efddc06dbc0 legacy=0x7efddc149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc40039b0 0x7efdc4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdc4004800 0x7efdc4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc4005270 0x7efdc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efddc06f730 con 0x7efdc4004800 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efdc400c200 con 0x7efdc40039b0 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efdc400c400 con 0x7efdc4005270 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd9d9b640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdc4004800 0x7efdc4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdda59c640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc40039b0 0x7efdc4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efddad9d640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc4005270 0x7efdc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd9d9b640 1 -- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc4005270 msgr2=0x7efdc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd9d9b640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdc4005270 0x7efdc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd9d9b640 1 -- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc40039b0 msgr2=0x7efdc4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd9d9b640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc40039b0 0x7efdc4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdd9d9b640 1 -- 172.21.15.33:0/3264990608 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc4003520 con 0x7efdc4004800 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efddad9d640 1 -- 172.21.15.33:0/3264990608 reap_dead start 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.505+0000 7efdda59c640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc40039b0 0x7efdc4003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:31:10.510 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.506+0000 7efdd9d9b640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdc4004800 0x7efdc4004c10 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7efddc14df70 tx=0x7efdc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6946940d8c2b68b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.506+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0007cf0 con 0x7efdc4004800 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.506+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efdd0005af0 con 0x7efdc4004800 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.506+0000 7efdd959a640 1 -- 172.21.15.33:0/3264990608 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0007070 con 0x7efdc4004800 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.507+0000 7efde0984640 1 -- 172.21.15.33:0/3264990608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdc4004800 msgr2=0x7efdc4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.507+0000 7efde0984640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdc4004800 0x7efdc4004c10 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7efddc14df70 tx=0x7efdc4005830 comp rx=0 tx=0).stop 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.507+0000 7efde0984640 1 -- 172.21.15.33:0/3264990608 shutdown_connections 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.507+0000 7efde0984640 1 --2- 172.21.15.33:0/3264990608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdc4004800 0x7efdc4004c10 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.507+0000 7efde0984640 1 -- 172.21.15.33:0/3264990608 >> 172.21.15.33:0/3264990608 conn(0x7efddc063ad0 msgr2=0x7efddc0bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.507+0000 7efde0984640 1 -- 172.21.15.33:0/3264990608 shutdown_connections 2024-04-25T15:31:10.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.507+0000 7efde0984640 1 -- 172.21.15.33:0/3264990608 wait complete. 2024-04-25T15:31:10.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.509+0000 7efde0984640 1 Processor -- start 2024-04-25T15:31:10.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.509+0000 7efde0984640 1 -- start start 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efde0984640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc4004800 0x7efddc1d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efde0984640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efddc0b4730 0x7efddc146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efde0984640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efddc1466a0 0x7efddc1d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efde0984640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7efddc0717e0 con 0x7efddc1466a0 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efde0984640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efddc149940 con 0x7efdc4004800 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efde0984640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efddc070550 con 0x7efddc0b4730 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efddc1466a0 0x7efddc1d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efddc1466a0 0x7efddc1d2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40156/0 (socket says 172.21.15.33:40156) 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 -- 172.21.15.33:0/546177178 learned_addr learned my addr 172.21.15.33:0/546177178 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efdd9d9b640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efddc0b4730 0x7efddc146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efdda59c640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc4004800 0x7efddc1d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 -- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efddc0b4730 msgr2=0x7efddc146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efddc0b4730 0x7efddc146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 -- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc4004800 msgr2=0x7efddc1d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc4004800 0x7efddc1d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 -- 172.21.15.33:0/546177178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc0b6aa0 con 0x7efddc1466a0 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efddad9d640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efddc1466a0 0x7efddc1d2f30 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7efdd4007fd0 tx=0x7efdd400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efdcaffd640 1 -- 172.21.15.33:0/546177178 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4003970 con 0x7efddc1466a0 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efdcaffd640 1 -- 172.21.15.33:0/546177178 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efdd4018070 con 0x7efddc1466a0 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efdcaffd640 1 -- 172.21.15.33:0/546177178 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4003d90 con 0x7efddc1466a0 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efddc1d14d0 con 0x7efddc1466a0 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.510+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efddc0b5f20 con 0x7efddc1466a0 2024-04-25T15:31:10.515 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.512+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efddc076200 con 0x7efddc1466a0 2024-04-25T15:31:10.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.512+0000 7efdcaffd640 1 -- 172.21.15.33:0/546177178 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7efdd40050d0 con 0x7efddc1466a0 2024-04-25T15:31:10.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.513+0000 7efdcaffd640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efdbc0744b0 0x7efdbc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.513+0000 7efdcaffd640 1 -- 172.21.15.33:0/546177178 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5896+0+0 (secure 0 0 0) 0x7efdd4095050 con 0x7efddc1466a0 2024-04-25T15:31:10.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.513+0000 7efdda59c640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efdbc0744b0 0x7efdbc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.514+0000 7efdda59c640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efdbc0744b0 0x7efdbc0769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efddc0519b0 tx=0x7efdcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.518+0000 7efdcaffd640 1 -- 172.21.15.33:0/546177178 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efddc076200 con 0x7efddc1466a0 2024-04-25T15:31:10.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.743+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efddc0764e0 con 0x7efddc1466a0 2024-04-25T15:31:10.744 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.743+0000 7efdcaffd640 1 -- 172.21.15.33:0/546177178 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3524 (secure 0 0 0) 0x7efdd405f0d0 con 0x7efddc1466a0 2024-04-25T15:31:10.745 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:31:10.745 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2065139550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2065139550},{"type":"v1","addr":"172.21.15.155:6835","nonce":2065139550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:20:41.780676+0000","modified":"2024-04-25T15:20:44.800148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/23089112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":23089112},{"type":"v1","addr":"172.21.15.33:6833","nonce":23089112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-04-25T15:31:10.745 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-04-25T15:31:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efdbc0744b0 msgr2=0x7efdbc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efdbc0744b0 0x7efdbc0769c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efddc0519b0 tx=0x7efdcc008040 comp rx=0 tx=0).stop 2024-04-25T15:31:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efddc1466a0 msgr2=0x7efddc1d2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efddc1466a0 0x7efddc1d2f30 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7efdd4007fd0 tx=0x7efdd400ec10 comp rx=0 tx=0).stop 2024-04-25T15:31:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 shutdown_connections 2024-04-25T15:31:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7efdbc0744b0 0x7efdbc0769c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efddc1466a0 0x7efddc1d2f30 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efddc0b4730 0x7efddc146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 --2- 172.21.15.33:0/546177178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdc4004800 0x7efddc1d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 >> 172.21.15.33:0/546177178 conn(0x7efddc063ad0 msgr2=0x7efddc1491b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 shutdown_connections 2024-04-25T15:31:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.745+0000 7efde0984640 1 -- 172.21.15.33:0/546177178 wait complete. 2024-04-25T15:31:10.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T15:31:10.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.868+0000 7f1c1e80c640 1 Processor -- start 2024-04-25T15:31:10.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.868+0000 7f1c1e80c640 1 -- start start 2024-04-25T15:31:10.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c1e80c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c1806d230 0x7f1c180bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c1e80c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c180bcf30 0x7f1c1809d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c1e80c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c18149d40 con 0x7f1c18149840 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c1e80c640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f1c1814a820 con 0x7f1c1806d230 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c1e80c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1814a020 con 0x7f1c180bcf30 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c177fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c1806d230 0x7f1c180bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c177fe640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1c1806d230 0x7f1c180bc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40160/0 (socket says 172.21.15.33:40160) 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c177fe640 1 -- 172.21.15.33:0/1244561471 learned_addr learned my addr 172.21.15.33:0/1244561471 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c1cda9640 1 --2- 172.21.15.33:0/1244561471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c180bcf30 0x7f1c1809d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c177fe640 1 -- 172.21.15.33:0/1244561471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c180bcf30 msgr2=0x7f1c1809d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c177fe640 1 --2- 172.21.15.33:0/1244561471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c180bcf30 0x7f1c1809d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c177fe640 1 -- 172.21.15.33:0/1244561471 >> v1:172.21.15.155:6789/0 conn(0x7f1c18149840 legacy=0x7f1c180be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.869+0000 7f1c177fe640 1 -- 172.21.15.33:0/1244561471 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1814a300 con 0x7f1c1806d230 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.870+0000 7f1c177fe640 1 --2- 172.21.15.33:0/1244561471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c1806d230 0x7f1c180bc9f0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009870 tx=0x7f1c0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104a779e50bd01ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.870+0000 7f1c16ffd640 1 -- 172.21.15.33:0/1244561471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08037070 con 0x7f1c1806d230 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.870+0000 7f1c16ffd640 1 -- 172.21.15.33:0/1244561471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1c08032440 con 0x7f1c1806d230 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.870+0000 7f1c16ffd640 1 -- 172.21.15.33:0/1244561471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08032830 con 0x7f1c1806d230 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.871+0000 7f1c1e80c640 1 -- 172.21.15.33:0/1244561471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c1806d230 msgr2=0x7f1c180bc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.871+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/1244561471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c1806d230 0x7f1c180bc9f0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009870 tx=0x7f1c0802a270 comp rx=0 tx=0).stop 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.871+0000 7f1c1e80c640 1 -- 172.21.15.33:0/1244561471 shutdown_connections 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.871+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/1244561471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c180bcf30 0x7f1c1809d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.871+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/1244561471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c1806d230 0x7f1c180bc9f0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.871+0000 7f1c1e80c640 1 -- 172.21.15.33:0/1244561471 >> 172.21.15.33:0/1244561471 conn(0x7f1c180bebf0 msgr2=0x7f1c180bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.871+0000 7f1c1e80c640 1 -- 172.21.15.33:0/1244561471 shutdown_connections 2024-04-25T15:31:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.871+0000 7f1c1e80c640 1 -- 172.21.15.33:0/1244561471 wait complete. 2024-04-25T15:31:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.872+0000 7f1c1e80c640 1 Processor -- start 2024-04-25T15:31:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.872+0000 7f1c1e80c640 1 -- start start 2024-04-25T15:31:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.873+0000 7f1c1e80c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c1806d230 0x7f1c180b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.873+0000 7f1c1e80c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c180bcf30 0x7f1c181d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.873+0000 7f1c1e80c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c18149840 0x7f1c181d5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.873+0000 7f1c1e80c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1809daa0 con 0x7f1c180bcf30 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.873+0000 7f1c1e80c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1809d920 con 0x7f1c18149840 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.873+0000 7f1c1e80c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1809dc20 con 0x7f1c1806d230 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c180bcf30 0x7f1c181d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c180bcf30 0x7f1c181d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40164/0 (socket says 172.21.15.33:40164) 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 -- 172.21.15.33:0/2353628868 learned_addr learned my addr 172.21.15.33:0/2353628868 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c17fff640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c1806d230 0x7f1c180b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c1cda9640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c18149840 0x7f1c181d5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 -- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c1806d230 msgr2=0x7f1c180b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c1806d230 0x7f1c180b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 -- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c18149840 msgr2=0x7f1c181d5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c18149840 0x7f1c181d5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 -- 172.21.15.33:0/2353628868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c181df5d0 con 0x7f1c180bcf30 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c1cda9640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c18149840 0x7f1c181d5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T15:31:10.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c177fe640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c180bcf30 0x7f1c181d59a0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f1c08000c00 tx=0x7f1c080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c14ff9640 1 -- 172.21.15.33:0/2353628868 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08037040 con 0x7f1c180bcf30 2024-04-25T15:31:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c14ff9640 1 -- 172.21.15.33:0/2353628868 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1c08042070 con 0x7f1c180bcf30 2024-04-25T15:31:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c180a2f80 con 0x7f1c180bcf30 2024-04-25T15:31:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c14ff9640 1 -- 172.21.15.33:0/2353628868 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08030bb0 con 0x7f1c180bcf30 2024-04-25T15:31:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.874+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c181dfb70 con 0x7f1c180bcf30 2024-04-25T15:31:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.875+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c180764e0 con 0x7f1c180bcf30 2024-04-25T15:31:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.876+0000 7f1c14ff9640 1 -- 172.21.15.33:0/2353628868 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1c08047460 con 0x7f1c180bcf30 2024-04-25T15:31:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.877+0000 7f1c14ff9640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1bf80744b0 0x7f1bf80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.877+0000 7f1c14ff9640 1 -- 172.21.15.33:0/2353628868 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5896+0+0 (secure 0 0 0) 0x7f1c080b6060 con 0x7f1c180bcf30 2024-04-25T15:31:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.877+0000 7f1c17fff640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1bf80744b0 0x7f1bf80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.878+0000 7f1c17fff640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1bf80744b0 0x7f1bf80769c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c00007fd0 tx=0x7f1c00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:10.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:10.882+0000 7f1c14ff9640 1 -- 172.21.15.33:0/2353628868 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c08032e20 con 0x7f1c180bcf30 2024-04-25T15:31:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.105+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c18148860 con 0x7f1c180bcf30 2024-04-25T15:31:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.105+0000 7f1c14ff9640 1 -- 172.21.15.33:0/2353628868 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+3524 (secure 0 0 0) 0x7f1c08080690 con 0x7f1c180bcf30 2024-04-25T15:31:11.107 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:31:11.107 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2065139550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2065139550},{"type":"v1","addr":"172.21.15.155:6835","nonce":2065139550}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T15:20:41.780676+0000","modified":"2024-04-25T15:20:44.800148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6833/23089112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":23089112},{"type":"v1","addr":"172.21.15.33:6833","nonce":23089112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4269,"qdb_cluster":[4269]},"id":1}]} 2024-04-25T15:31:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-04-25T15:31:11.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.107+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1bf80744b0 msgr2=0x7f1bf80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.107+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1bf80744b0 0x7f1bf80769c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c00007fd0 tx=0x7f1c00009040 comp rx=0 tx=0).stop 2024-04-25T15:31:11.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.107+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c180bcf30 msgr2=0x7f1c181d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.107+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c180bcf30 0x7f1c181d59a0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f1c08000c00 tx=0x7f1c080046c0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.107+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 shutdown_connections 2024-04-25T15:31:11.109 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.108+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f1bf80744b0 0x7f1bf80769c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.108+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c18149840 0x7f1c181d5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.108+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c180bcf30 0x7f1c181d59a0 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.108+0000 7f1c1e80c640 1 --2- 172.21.15.33:0/2353628868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c1806d230 0x7f1c180b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.108+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 >> 172.21.15.33:0/2353628868 conn(0x7f1c180bebf0 msgr2=0x7f1c180b9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:11.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.108+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 shutdown_connections 2024-04-25T15:31:11.110 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.108+0000 7f1c1e80c640 1 -- 172.21.15.33:0/2353628868 wait complete. 2024-04-25T15:31:11.120 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T15:31:11.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.230+0000 7f620fc8c640 1 Processor -- start 2024-04-25T15:31:11.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.230+0000 7f620fc8c640 1 -- start start 2024-04-25T15:31:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620fc8c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6208070550 0x7f62080b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620fc8c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6208148360 0x7f6208151f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620fc8c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62080b3c50 con 0x7f62080b23e0 2024-04-25T15:31:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620fc8c640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f62080b8730 con 0x7f6208148360 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620fc8c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f62080b8cf0 con 0x7f6208070550 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620e229640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6208148360 0x7f6208151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620e229640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6208148360 0x7f6208151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40170/0 (socket says 172.21.15.33:40170) 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620e229640 1 -- 172.21.15.33:0/4036186676 learned_addr learned my addr 172.21.15.33:0/4036186676 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.231+0000 7f620da28640 1 --2- 172.21.15.33:0/4036186676 >> v2:172.21.15.155:3300/0 conn(0x7f6208070550 0x7f62080b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.232+0000 7f620e229640 1 -- 172.21.15.33:0/4036186676 >> v2:172.21.15.155:3300/0 conn(0x7f6208070550 msgr2=0x7f62080b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.232+0000 7f620e229640 1 --2- 172.21.15.33:0/4036186676 >> v2:172.21.15.155:3300/0 conn(0x7f6208070550 0x7f62080b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.232+0000 7f620e229640 1 -- 172.21.15.33:0/4036186676 >> v1:172.21.15.155:6789/0 conn(0x7f62080b23e0 legacy=0x7f6208147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.232+0000 7f620e229640 1 -- 172.21.15.33:0/4036186676 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62080b1a70 con 0x7f6208148360 2024-04-25T15:31:11.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.233+0000 7f620e229640 1 --2- 172.21.15.33:0/4036186676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6208148360 0x7f6208151f90 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f6200009e50 tx=0x7f620002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9f78b37edd82f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.233+0000 7f620ca26640 1 -- 172.21.15.33:0/4036186676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200036070 con 0x7f6208148360 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.233+0000 7f620ca26640 1 -- 172.21.15.33:0/4036186676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6200031600 con 0x7f6208148360 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.233+0000 7f620ca26640 1 -- 172.21.15.33:0/4036186676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62000319f0 con 0x7f6208148360 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.234+0000 7f620fc8c640 1 -- 172.21.15.33:0/4036186676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6208148360 msgr2=0x7f6208151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.234+0000 7f620fc8c640 1 --2- 172.21.15.33:0/4036186676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6208148360 0x7f6208151f90 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f6200009e50 tx=0x7f620002a640 comp rx=0 tx=0).stop 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.234+0000 7f620fc8c640 1 -- 172.21.15.33:0/4036186676 shutdown_connections 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.234+0000 7f620fc8c640 1 --2- 172.21.15.33:0/4036186676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6208148360 0x7f6208151f90 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.234+0000 7f620fc8c640 1 --2- 172.21.15.33:0/4036186676 >> v2:172.21.15.155:3300/0 conn(0x7f6208070550 0x7f62080b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.234+0000 7f620fc8c640 1 -- 172.21.15.33:0/4036186676 >> 172.21.15.33:0/4036186676 conn(0x7f6208063ad0 msgr2=0x7f62080bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.234+0000 7f620fc8c640 1 -- 172.21.15.33:0/4036186676 shutdown_connections 2024-04-25T15:31:11.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.234+0000 7f620fc8c640 1 -- 172.21.15.33:0/4036186676 wait complete. 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.235+0000 7f620fc8c640 1 Processor -- start 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.235+0000 7f620fc8c640 1 -- start start 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620fc8c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6208070550 0x7f620814aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620fc8c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62080b23e0 0x7f620806ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620fc8c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6208148360 0x7f620813ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620fc8c640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f6208148770 con 0x7f62080b23e0 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620fc8c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62080b3270 con 0x7f6208148360 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620fc8c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6208070960 con 0x7f6208070550 2024-04-25T15:31:11.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620d227640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62080b23e0 0x7f620806ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620d227640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62080b23e0 0x7f620806ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40186/0 (socket says 172.21.15.33:40186) 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620d227640 1 -- 172.21.15.33:0/1483946249 learned_addr learned my addr 172.21.15.33:0/1483946249 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620da28640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6208070550 0x7f620814aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.236+0000 7f620e229640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6208148360 0x7f620813ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620d227640 1 -- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6208070550 msgr2=0x7f620814aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620d227640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6208070550 0x7f620814aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620d227640 1 -- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6208148360 msgr2=0x7f620813ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620d227640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6208148360 0x7f620813ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620d227640 1 -- 172.21.15.33:0/1483946249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620806f360 con 0x7f62080b23e0 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620e229640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6208148360 0x7f620813ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620d227640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62080b23e0 0x7f620806ee20 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f620400c470 tx=0x7f620400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f61fe7fc640 1 -- 172.21.15.33:0/1483946249 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040052d0 con 0x7f62080b23e0 2024-04-25T15:31:11.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f61fe7fc640 1 -- 172.21.15.33:0/1483946249 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6204005490 con 0x7f62080b23e0 2024-04-25T15:31:11.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62080a1c30 con 0x7f62080b23e0 2024-04-25T15:31:11.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f61fe7fc640 1 -- 172.21.15.33:0/1483946249 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204007280 con 0x7f62080b23e0 2024-04-25T15:31:11.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.237+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6208143840 con 0x7f62080b23e0 2024-04-25T15:31:11.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.238+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62080764e0 con 0x7f62080b23e0 2024-04-25T15:31:11.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.239+0000 7f61fe7fc640 1 -- 172.21.15.33:0/1483946249 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6204007420 con 0x7f62080b23e0 2024-04-25T15:31:11.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.239+0000 7f61fe7fc640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f61ec0744b0 0x7f61ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.239+0000 7f61fe7fc640 1 -- 172.21.15.33:0/1483946249 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5896+0+0 (secure 0 0 0) 0x7f62040946d0 con 0x7f62080b23e0 2024-04-25T15:31:11.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.239+0000 7f620da28640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f61ec0744b0 0x7f61ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.240+0000 7f620da28640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f61ec0744b0 0x7f61ec0769c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009a30 tx=0x7f61f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.244+0000 7f61fe7fc640 1 -- 172.21.15.33:0/1483946249 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f620405ee30 con 0x7f62080b23e0 2024-04-25T15:31:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.430+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62080b5f40 con 0x7f62080b23e0 2024-04-25T15:31:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.431+0000 7f61fe7fc640 1 -- 172.21.15.33:0/1483946249 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16970 (secure 0 0 0) 0x7f620405e730 con 0x7f62080b23e0 2024-04-25T15:31:11.433 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-04-25T15:31:11.433 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":43,"fsid":"674605f9-f613-4a95-b0f3-ac5870429d94","created":"2024-04-25T15:20:17.473802+0000","modified":"2024-04-25T15:30:57.342055+0000","last_up_change":"2024-04-25T15:20:28.829067+0000","last_in_change":"2024-04-25T15:20:19.658127+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T15:20:29.721824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T15:20:39.967842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T15:20:40.725695+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":51,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"727fa4ab-1326-4836-bb36-1e6f1894a061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6825","nonce":3758744180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6827","nonce":3758744180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6831","nonce":3758744180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3758744180},{"type":"v1","addr":"172.21.15.33:6829","nonce":3758744180}]},"public_addr":"172.21.15.33:6825/3758744180","cluster_addr":"172.21.15.33:6827/3758744180","heartbeat_back_addr":"172.21.15.33:6831/3758744180","heartbeat_front_addr":"172.21.15.33:6829/3758744180","state":["exists","up"]},{"osd":1,"uuid":"3a03cc6c-497d-4b8d-a588-5522635c93c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6801","nonce":3783939985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6803","nonce":3783939985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6807","nonce":3783939985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3783939985},{"type":"v1","addr":"172.21.15.33:6805","nonce":3783939985}]},"public_addr":"172.21.15.33:6801/3783939985","cluster_addr":"172.21.15.33:6803/3783939985","heartbeat_back_addr":"172.21.15.33:6807/3783939985","heartbeat_front_addr":"172.21.15.33:6805/3783939985","state":["exists","up"]},{"osd":2,"uuid":"c05e19af-430b-47e6-a8aa-5cae483ed041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6817","nonce":1934245664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6819","nonce":1934245664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6823","nonce":1934245664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":1934245664},{"type":"v1","addr":"172.21.15.33:6821","nonce":1934245664}]},"public_addr":"172.21.15.33:6817/1934245664","cluster_addr":"172.21.15.33:6819/1934245664","heartbeat_back_addr":"172.21.15.33:6823/1934245664","heartbeat_front_addr":"172.21.15.33:6821/1934245664","state":["exists","up"]},{"osd":3,"uuid":"3d2383d8-b32f-4add-b0b3-fc1f294598e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6809","nonce":2009635003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6811","nonce":2009635003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6815","nonce":2009635003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2009635003},{"type":"v1","addr":"172.21.15.33:6813","nonce":2009635003}]},"public_addr":"172.21.15.33:6809/2009635003","cluster_addr":"172.21.15.33:6811/2009635003","heartbeat_back_addr":"172.21.15.33:6815/2009635003","heartbeat_front_addr":"172.21.15.33:6813/2009635003","state":["exists","up"]},{"osd":4,"uuid":"89bdfcc2-bb8a-43db-8cc7-530b59758f0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6825","nonce":136572947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6827","nonce":136572947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6831","nonce":136572947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":136572947},{"type":"v1","addr":"172.21.15.155:6829","nonce":136572947}]},"public_addr":"172.21.15.155:6825/136572947","cluster_addr":"172.21.15.155:6827/136572947","heartbeat_back_addr":"172.21.15.155:6831/136572947","heartbeat_front_addr":"172.21.15.155:6829/136572947","state":["exists","up"]},{"osd":5,"uuid":"243b8252-3532-4e5b-9fa1-cec012000b0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6801","nonce":753631458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6803","nonce":753631458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6807","nonce":753631458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":753631458},{"type":"v1","addr":"172.21.15.155:6805","nonce":753631458}]},"public_addr":"172.21.15.155:6801/753631458","cluster_addr":"172.21.15.155:6803/753631458","heartbeat_back_addr":"172.21.15.155:6807/753631458","heartbeat_front_addr":"172.21.15.155:6805/753631458","state":["exists","up"]},{"osd":6,"uuid":"3b26a204-fd86-4c54-a4a0-bc6bf77ca794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6810","nonce":1724039057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6813","nonce":1724039057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6820","nonce":1724039057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":1724039057},{"type":"v1","addr":"172.21.15.155:6817","nonce":1724039057}]},"public_addr":"172.21.15.155:6810/1724039057","cluster_addr":"172.21.15.155:6813/1724039057","heartbeat_back_addr":"172.21.15.155:6820/1724039057","heartbeat_front_addr":"172.21.15.155:6817/1724039057","state":["exists","up"]},{"osd":7,"uuid":"9cad4aaa-b466-4003-a125-8eb3113d995a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6811","nonce":1726313221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6816","nonce":1726313221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6823","nonce":1726313221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6819","nonce":1726313221},{"type":"v1","addr":"172.21.15.155:6821","nonce":1726313221}]},"public_addr":"172.21.15.155:6811/1726313221","cluster_addr":"172.21.15.155:6816/1726313221","heartbeat_back_addr":"172.21.15.155:6823/1726313221","heartbeat_front_addr":"172.21.15.155:6821/1726313221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.868827+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.742047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.847760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.857534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.831111+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.811752+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.888258+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T15:20:24.795570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":3,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1370918468":"2024-04-25T16:24:51.186771+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":49,"length":3}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T15:31:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f61ec0744b0 msgr2=0x7f61ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f61ec0744b0 0x7f61ec0769c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009a30 tx=0x7f61f8008040 comp rx=0 tx=0).stop 2024-04-25T15:31:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62080b23e0 msgr2=0x7f620806ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62080b23e0 0x7f620806ee20 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f620400c470 tx=0x7f620400c930 comp rx=0 tx=0).stop 2024-04-25T15:31:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 shutdown_connections 2024-04-25T15:31:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f61ec0744b0 0x7f61ec0769c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6208148360 0x7f620813ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62080b23e0 0x7f620806ee20 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 --2- 172.21.15.33:0/1483946249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6208070550 0x7f620814aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.433+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 >> 172.21.15.33:0/1483946249 conn(0x7f6208063ad0 msgr2=0x7f6208147170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.434+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 shutdown_connections 2024-04-25T15:31:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.434+0000 7f620fc8c640 1 -- 172.21.15.33:0/1483946249 wait complete. 2024-04-25T15:31:11.446 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T15:31:11.558 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.557+0000 7f0f40ae0640 1 Processor -- start 2024-04-25T15:31:11.559 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.557+0000 7f0f40ae0640 1 -- start start 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f40ae0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c073150 0x7f0f3c143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f40ae0640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f3c0bbf60 0x7f0f3c14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f40ae0640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3c0b69f0 con 0x7f0f3c0bc370 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f40ae0640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3c073f30 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f40ae0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c0b7040 con 0x7f0f3c073150 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f39d9b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f3c0bbf60 0x7f0f3c14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f39d9b640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f3c0bbf60 0x7f0f3c14cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40194/0 (socket says 172.21.15.33:40194) 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f3ad9d640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0f3c0bc370 0x7f0f3c06c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47576/0 (socket says 172.21.15.33:47576) 2024-04-25T15:31:11.561 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.558+0000 7f0f39d9b640 1 -- 172.21.15.33:0/3607775379 learned_addr learned my addr 172.21.15.33:0/3607775379 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.559+0000 7f0f3a59c640 1 --2- 172.21.15.33:0/3607775379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c073150 0x7f0f3c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.559+0000 7f0f39d9b640 1 -- 172.21.15.33:0/3607775379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c073150 msgr2=0x7f0f3c143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.559+0000 7f0f39d9b640 1 --2- 172.21.15.33:0/3607775379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c073150 0x7f0f3c143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.559+0000 7f0f39d9b640 1 -- 172.21.15.33:0/3607775379 >> v1:172.21.15.33:6789/0 conn(0x7f0f3c0bc370 legacy=0x7f0f3c06c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.559+0000 7f0f39d9b640 1 -- 172.21.15.33:0/3607775379 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c0b6cd0 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.559+0000 7f0f3959a640 1 -- 172.21.15.33:0/3607775379 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188951515 0 0) 0x7f0f3c0b69f0 con 0x7f0f3c0bc370 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.560+0000 7f0f39d9b640 1 --2- 172.21.15.33:0/3607775379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c14cd80 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009870 tx=0x7f0f2402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bc94267e53e425 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.560+0000 7f0f3959a640 1 -- 172.21.15.33:0/3607775379 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24037070 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.560+0000 7f0f3959a640 1 -- 172.21.15.33:0/3607775379 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0f24032440 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.562 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.560+0000 7f0f3959a640 1 -- 172.21.15.33:0/3607775379 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24032830 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.563 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.560+0000 7f0f40ae0640 1 -- 172.21.15.33:0/3607775379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 msgr2=0x7f0f3c14cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.560+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/3607775379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c14cd80 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009870 tx=0x7f0f2402a1c0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.561+0000 7f0f40ae0640 1 -- 172.21.15.33:0/3607775379 shutdown_connections 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.561+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/3607775379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c14cd80 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.561+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/3607775379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c073150 0x7f0f3c143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.561+0000 7f0f40ae0640 1 -- 172.21.15.33:0/3607775379 >> 172.21.15.33:0/3607775379 conn(0x7f0f3c0b8b10 msgr2=0x7f0f3c0bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.561+0000 7f0f40ae0640 1 -- 172.21.15.33:0/3607775379 shutdown_connections 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.561+0000 7f0f40ae0640 1 -- 172.21.15.33:0/3607775379 wait complete. 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.562+0000 7f0f40ae0640 1 Processor -- start 2024-04-25T15:31:11.564 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.562+0000 7f0f40ae0640 1 -- start start 2024-04-25T15:31:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f40ae0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c073150 0x7f0f3c144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f40ae0640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c0b9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f40ae0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c0bc370 0x7f0f3c0b9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f40ae0640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c073560 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.566 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f40ae0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c0b6680 con 0x7f0f3c073150 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f40ae0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c0736e0 con 0x7f0f3c0bc370 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f39d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c0b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f39d9b640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c0b9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40208/0 (socket says 172.21.15.33:40208) 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f39d9b640 1 -- 172.21.15.33:0/2411562251 learned_addr learned my addr 172.21.15.33:0/2411562251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f3ad9d640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c0bc370 0x7f0f3c0b9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.563+0000 7f0f3a59c640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c073150 0x7f0f3c144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f39d9b640 1 -- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c0bc370 msgr2=0x7f0f3c0b9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f39d9b640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c0bc370 0x7f0f3c0b9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f39d9b640 1 -- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c073150 msgr2=0x7f0f3c144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f39d9b640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c073150 0x7f0f3c144900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f39d9b640 1 -- 172.21.15.33:0/2411562251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c06cf20 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f39d9b640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c0b9690 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009870 tx=0x7f0f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f32ffd640 1 -- 172.21.15.33:0/2411562251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24037040 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f32ffd640 1 -- 172.21.15.33:0/2411562251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0f24004250 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c143fd0 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f32ffd640 1 -- 172.21.15.33:0/2411562251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24003610 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.564+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c06ca00 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.565+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3c1444f0 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.566+0000 7f0f32ffd640 1 -- 172.21.15.33:0/2411562251 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0f2402ad10 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.566+0000 7f0f32ffd640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0f1c0744b0 0x7f0f1c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.566+0000 7f0f32ffd640 1 -- 172.21.15.33:0/2411562251 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5896+0+0 (secure 0 0 0) 0x7f0f240b5d70 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.567+0000 7f0f3a59c640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0f1c0744b0 0x7f0f1c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.567+0000 7f0f3a59c640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0f1c0744b0 0x7f0f1c0769c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009aa0 tx=0x7f0f2c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.571+0000 7f0f32ffd640 1 -- 172.21.15.33:0/2411562251 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0f3c1444f0 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.797 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.796+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0f3c0764e0 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.798+0000 7f0f32ffd640 1 -- 172.21.15.33:0/2411562251 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f0f2407fdf0 con 0x7f0f3c0bbf60 2024-04-25T15:31:11.843 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T15:31:11.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0f1c0744b0 msgr2=0x7f0f1c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0f1c0744b0 0x7f0f1c0769c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009aa0 tx=0x7f0f2c009190 comp rx=0 tx=0).stop 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 msgr2=0x7f0f3c0b9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c0b9690 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009870 tx=0x7f0f240046c0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 shutdown_connections 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0f1c0744b0 0x7f0f1c0769c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f3c0bc370 0x7f0f3c0b9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0bbf60 0x7f0f3c0b9690 secure :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009870 tx=0x7f0f240046c0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 --2- 172.21.15.33:0/2411562251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3c073150 0x7f0f3c144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.801+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 >> 172.21.15.33:0/2411562251 conn(0x7f0f3c0b8b10 msgr2=0x7f0f3c147e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.802+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 shutdown_connections 2024-04-25T15:31:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.802+0000 7f0f40ae0640 1 -- 172.21.15.33:0/2411562251 wait complete. 2024-04-25T15:31:11.845 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T15:31:11.875 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2024-04-25T15:31:11.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.959+0000 7f8a67cf2640 1 Processor -- start 2024-04-25T15:31:11.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.959+0000 7f8a67cf2640 1 -- start start 2024-04-25T15:31:11.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.960+0000 7f8a67cf2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a6006d230 0x7f8a600bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.960+0000 7f8a67cf2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a600bcf30 0x7f8a6009d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.960+0000 7f8a67cf2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a60149d40 con 0x7f8a60149840 2024-04-25T15:31:11.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.960+0000 7f8a67cf2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6014a820 con 0x7f8a600bcf30 2024-04-25T15:31:11.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.960+0000 7f8a67cf2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6014a020 con 0x7f8a6006d230 2024-04-25T15:31:11.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.961+0000 7f8a6628f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a600bcf30 0x7f8a6009d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.961+0000 7f8a6528d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a6006d230 0x7f8a600bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.961+0000 7f8a6628f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a600bcf30 0x7f8a6009d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.33:58390/0 (socket says 172.21.15.33:58390) 2024-04-25T15:31:11.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.961+0000 7f8a6628f640 1 -- 172.21.15.33:0/1434835457 learned_addr learned my addr 172.21.15.33:0/1434835457 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:11.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.961+0000 7f8a6528d640 1 -- 172.21.15.33:0/1434835457 >> v2:172.21.15.155:3300/0 conn(0x7f8a600bcf30 msgr2=0x7f8a6009d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:11.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.961+0000 7f8a6528d640 1 --2- 172.21.15.33:0/1434835457 >> v2:172.21.15.155:3300/0 conn(0x7f8a600bcf30 0x7f8a6009d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.961+0000 7f8a6528d640 1 -- 172.21.15.33:0/1434835457 >> v1:172.21.15.155:6789/0 conn(0x7f8a60149840 legacy=0x7f8a600be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.963 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.961+0000 7f8a6528d640 1 -- 172.21.15.33:0/1434835457 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6014a300 con 0x7f8a6006d230 2024-04-25T15:31:11.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.962+0000 7f8a6528d640 1 --2- 172.21.15.33:0/1434835457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a6006d230 0x7f8a600bc9f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8a540097a0 tx=0x7f8a5402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ac3b2e50145d73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.962+0000 7f8a64a8c640 1 -- 172.21.15.33:0/1434835457 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54037070 con 0x7f8a6006d230 2024-04-25T15:31:11.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.962+0000 7f8a64a8c640 1 -- 172.21.15.33:0/1434835457 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a54032440 con 0x7f8a6006d230 2024-04-25T15:31:11.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.962+0000 7f8a64a8c640 1 -- 172.21.15.33:0/1434835457 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54032830 con 0x7f8a6006d230 2024-04-25T15:31:11.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.963+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1434835457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a6006d230 msgr2=0x7f8a600bc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.963+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1434835457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a6006d230 0x7f8a600bc9f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8a540097a0 tx=0x7f8a5402a180 comp rx=0 tx=0).stop 2024-04-25T15:31:11.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.963+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1434835457 shutdown_connections 2024-04-25T15:31:11.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.963+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1434835457 >> v2:172.21.15.155:3300/0 conn(0x7f8a600bcf30 0x7f8a6009d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.963+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1434835457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a6006d230 0x7f8a600bc9f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.963+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1434835457 >> 172.21.15.33:0/1434835457 conn(0x7f8a600bebf0 msgr2=0x7f8a600bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:11.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.963+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1434835457 shutdown_connections 2024-04-25T15:31:11.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.963+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1434835457 wait complete. 2024-04-25T15:31:11.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.964+0000 7f8a67cf2640 1 Processor -- start 2024-04-25T15:31:11.966 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.964+0000 7f8a67cf2640 1 -- start start 2024-04-25T15:31:11.967 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a67cf2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6006d230 0x7f8a600a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a67cf2640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a600bcf30 0x7f8a600a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a67cf2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a60149840 0x7f8a600a4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a67cf2640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6009daa0 con 0x7f8a600bcf30 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a67cf2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6009d920 con 0x7f8a6006d230 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a67cf2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6009dc20 con 0x7f8a60149840 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a6528d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a600bcf30 0x7f8a600a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a6528d640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a600bcf30 0x7f8a600a4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40238/0 (socket says 172.21.15.33:40238) 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a6528d640 1 -- 172.21.15.33:0/1061083466 learned_addr learned my addr 172.21.15.33:0/1061083466 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a6628f640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a60149840 0x7f8a600a4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.965+0000 7f8a65a8e640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6006d230 0x7f8a600a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a6528d640 1 -- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a60149840 msgr2=0x7f8a600a4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a6528d640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a60149840 0x7f8a600a4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a6528d640 1 -- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6006d230 msgr2=0x7f8a600a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a6528d640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6006d230 0x7f8a600a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a6528d640 1 -- 172.21.15.33:0/1061083466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600b4260 con 0x7f8a600bcf30 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a6528d640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a600bcf30 0x7f8a600a4010 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f8a5402a1c0 tx=0x7f8a540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a5e7fc640 1 -- 172.21.15.33:0/1061083466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54041030 con 0x7f8a600bcf30 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a5e7fc640 1 -- 172.21.15.33:0/1061083466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a54030580 con 0x7f8a600bcf30 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a5e7fc640 1 -- 172.21.15.33:0/1061083466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54037040 con 0x7f8a600bcf30 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a600b4540 con 0x7f8a600bcf30 2024-04-25T15:31:11.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.966+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a600b4d40 con 0x7f8a600bcf30 2024-04-25T15:31:11.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.967+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a600764e0 con 0x7f8a600bcf30 2024-04-25T15:31:11.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.968+0000 7f8a5e7fc640 1 -- 172.21.15.33:0/1061083466 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8a54044070 con 0x7f8a600bcf30 2024-04-25T15:31:11.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.968+0000 7f8a5e7fc640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8a4c0744e0 0x7f8a4c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:11.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.968+0000 7f8a5e7fc640 1 -- 172.21.15.33:0/1061083466 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5954+0+0 (secure 0 0 0) 0x7f8a540b5800 con 0x7f8a600bcf30 2024-04-25T15:31:11.970 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.969+0000 7f8a65a8e640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8a4c0744e0 0x7f8a4c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:11.971 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.969+0000 7f8a65a8e640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8a4c0744e0 0x7f8a4c0769f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000f60 tx=0x7f8a58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:11.978 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:11.977+0000 7f8a5e7fc640 1 -- 172.21.15.33:0/1061083466 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a5407f7c0 con 0x7f8a600bcf30 2024-04-25T15:31:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.203+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8a600b85c0 con 0x7f8a600bcf30 2024-04-25T15:31:12.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.805+0000 7f8a5e7fc640 1 -- 172.21.15.33:0/1061083466 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f8a54083ac0 con 0x7f8a600bcf30 2024-04-25T15:31:12.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8a4c0744e0 msgr2=0x7f8a4c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:12.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8a4c0744e0 0x7f8a4c0769f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000f60 tx=0x7f8a58009040 comp rx=0 tx=0).stop 2024-04-25T15:31:12.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a600bcf30 msgr2=0x7f8a600a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:12.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a600bcf30 0x7f8a600a4010 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f8a5402a1c0 tx=0x7f8a540046c0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 shutdown_connections 2024-04-25T15:31:12.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f8a4c0744e0 0x7f8a4c0769f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a60149840 0x7f8a600a4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a600bcf30 0x7f8a600a4010 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 --2- 172.21.15.33:0/1061083466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6006d230 0x7f8a600a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 >> 172.21.15.33:0/1061083466 conn(0x7f8a600bebf0 msgr2=0x7f8a600b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:12.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 shutdown_connections 2024-04-25T15:31:12.810 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.808+0000 7f8a67cf2640 1 -- 172.21.15.33:0/1061083466 wait complete. 2024-04-25T15:31:12.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T15:31:12.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.975+0000 7f0c30ff3640 1 Processor -- start 2024-04-25T15:31:12.977 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.975+0000 7f0c30ff3640 1 -- start start 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.976+0000 7f0c30ff3640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0c2c0b3770 0x7f0c2c0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.976+0000 7f0c30ff3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0c2c0b91f0 0x7f0c2c0b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.976+0000 7f0c30ff3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c0b4050 con 0x7f0c2c0b6c90 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.976+0000 7f0c30ff3640 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c0b4a60 con 0x7f0c2c0b3770 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.976+0000 7f0c30ff3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c0b4d40 con 0x7f0c2c0b91f0 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.977+0000 7f0c2a59c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0c2c0b3770 0x7f0c2c0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.977+0000 7f0c2a59c640 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0c2c0b3770 0x7f0c2c0b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40248/0 (socket says 172.21.15.33:40248) 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.977+0000 7f0c2a59c640 1 -- 172.21.15.33:0/160768085 learned_addr learned my addr 172.21.15.33:0/160768085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.977+0000 7f0c23fff640 1 --2- 172.21.15.33:0/160768085 >> v2:172.21.15.155:3300/0 conn(0x7f0c2c0b91f0 0x7f0c2c0b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:12.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.977+0000 7f0c2a59c640 1 -- 172.21.15.33:0/160768085 >> v2:172.21.15.155:3300/0 conn(0x7f0c2c0b91f0 msgr2=0x7f0c2c0b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:12.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.977+0000 7f0c2a59c640 1 --2- 172.21.15.33:0/160768085 >> v2:172.21.15.155:3300/0 conn(0x7f0c2c0b91f0 0x7f0c2c0b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.977+0000 7f0c2a59c640 1 -- 172.21.15.33:0/160768085 >> v1:172.21.15.155:6789/0 conn(0x7f0c2c0b6c90 legacy=0x7f0c2c141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:12.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.977+0000 7f0c2a59c640 1 -- 172.21.15.33:0/160768085 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c0b42f0 con 0x7f0c2c0b3770 2024-04-25T15:31:12.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c2a59c640 1 --2- 172.21.15.33:0/160768085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c0b51d0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0b4be0 tx=0x7f0c1c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89561dc14420b534 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:12.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c29d9b640 1 -- 172.21.15.33:0/160768085 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c037070 con 0x7f0c2c0b3770 2024-04-25T15:31:12.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c29d9b640 1 -- 172.21.15.33:0/160768085 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0c1c02ae10 con 0x7f0c2c0b3770 2024-04-25T15:31:12.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c29d9b640 1 -- 172.21.15.33:0/160768085 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c032680 con 0x7f0c2c0b3770 2024-04-25T15:31:12.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c30ff3640 1 -- 172.21.15.33:0/160768085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 msgr2=0x7f0c2c0b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:12.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/160768085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c0b51d0 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0b4be0 tx=0x7f0c1c02a100 comp rx=0 tx=0).stop 2024-04-25T15:31:12.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c30ff3640 1 -- 172.21.15.33:0/160768085 shutdown_connections 2024-04-25T15:31:12.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/160768085 >> v2:172.21.15.155:3300/0 conn(0x7f0c2c0b91f0 0x7f0c2c0b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/160768085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c0b51d0 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.978+0000 7f0c30ff3640 1 -- 172.21.15.33:0/160768085 >> 172.21.15.33:0/160768085 conn(0x7f0c2c074060 msgr2=0x7f0c2c06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:12.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.979+0000 7f0c30ff3640 1 -- 172.21.15.33:0/160768085 shutdown_connections 2024-04-25T15:31:12.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.979+0000 7f0c30ff3640 1 -- 172.21.15.33:0/160768085 wait complete. 2024-04-25T15:31:12.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.980+0000 7f0c30ff3640 1 Processor -- start 2024-04-25T15:31:12.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.980+0000 7f0c30ff3640 1 -- start start 2024-04-25T15:31:12.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c30ff3640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c1e0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:12.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c30ff3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2c0b6c90 0x7f0c2c1d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:12.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c30ff3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2c0b91f0 0x7f0c2c139880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:12.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c30ff3640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c141c40 con 0x7f0c2c0b3770 2024-04-25T15:31:12.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c30ff3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0b3b80 con 0x7f0c2c0b6c90 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c30ff3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c141dc0 con 0x7f0c2c0b91f0 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c2a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c1e0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c2a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c1e0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40250/0 (socket says 172.21.15.33:40250) 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c2a59c640 1 -- 172.21.15.33:0/4052466747 learned_addr learned my addr 172.21.15.33:0/4052466747 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c23fff640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2c0b6c90 0x7f0c2c1d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.981+0000 7f0c2ad9d640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2c0b91f0 0x7f0c2c139880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c2a59c640 1 -- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2c0b91f0 msgr2=0x7f0c2c139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c2a59c640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2c0b91f0 0x7f0c2c139880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c2a59c640 1 -- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2c0b6c90 msgr2=0x7f0c2c1d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c2a59c640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2c0b6c90 0x7f0c2c1d0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c2a59c640 1 -- 172.21.15.33:0/4052466747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c1e1780 con 0x7f0c2c0b3770 2024-04-25T15:31:12.985 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c2a59c640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c1e0a40 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000c00 tx=0x7f0c1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:12.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c22ffd640 1 -- 172.21.15.33:0/4052466747 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c041070 con 0x7f0c2c0b3770 2024-04-25T15:31:12.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c22ffd640 1 -- 172.21.15.33:0/4052466747 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0c1c03c670 con 0x7f0c2c0b3770 2024-04-25T15:31:12.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c22ffd640 1 -- 172.21.15.33:0/4052466747 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c037040 con 0x7f0c2c0b3770 2024-04-25T15:31:12.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c1d0fd0 con 0x7f0c2c0b3770 2024-04-25T15:31:12.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.982+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c1cfa90 con 0x7f0c2c0b3770 2024-04-25T15:31:12.986 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.983+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c0764e0 con 0x7f0c2c0b3770 2024-04-25T15:31:12.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.984+0000 7f0c22ffd640 1 -- 172.21.15.33:0/4052466747 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0c1c044070 con 0x7f0c2c0b3770 2024-04-25T15:31:12.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.984+0000 7f0c22ffd640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0c0c0744b0 0x7f0c0c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:12.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.984+0000 7f0c22ffd640 1 -- 172.21.15.33:0/4052466747 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5954+0+0 (secure 0 0 0) 0x7f0c1c0b5d40 con 0x7f0c2c0b3770 2024-04-25T15:31:12.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.985+0000 7f0c23fff640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0c0c0744b0 0x7f0c0c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:12.987 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.985+0000 7f0c23fff640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0c0c0744b0 0x7f0c0c0769c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0c14006fd0 tx=0x7f0c14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:12.990 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:12.989+0000 7f0c22ffd640 1 -- 172.21.15.33:0/4052466747 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0c1c0802b0 con 0x7f0c2c0b3770 2024-04-25T15:31:13.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.176+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c2c13c460 con 0x7f0c2c0b3770 2024-04-25T15:31:13.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.807+0000 7f0c22ffd640 1 -- 172.21.15.33:0/4052466747 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) ==== 181+0+0 (secure 0 0 0) 0x7f0c1c07fbb0 con 0x7f0c2c0b3770 2024-04-25T15:31:13.808 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-04-25T15:31:13.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0c0c0744b0 msgr2=0x7f0c0c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:13.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0c0c0744b0 0x7f0c0c0769c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0c14006fd0 tx=0x7f0c14008040 comp rx=0 tx=0).stop 2024-04-25T15:31:13.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 msgr2=0x7f0c2c1e0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:13.811 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c1e0a40 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000c00 tx=0x7f0c1c0046c0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 shutdown_connections 2024-04-25T15:31:13.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7f0c0c0744b0 0x7f0c0c0769c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2c0b91f0 0x7f0c2c139880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c2c0b6c90 0x7f0c2c1d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 --2- 172.21.15.33:0/4052466747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c2c0b3770 0x7f0c2c1e0a40 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.810+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 >> 172.21.15.33:0/4052466747 conn(0x7f0c2c074060 msgr2=0x7f0c2c0b9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.811+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 shutdown_connections 2024-04-25T15:31:13.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.811+0000 7f0c30ff3640 1 -- 172.21.15.33:0/4052466747 wait complete. 2024-04-25T15:31:13.829 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T15:31:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.944+0000 7fc330e84640 1 Processor -- start 2024-04-25T15:31:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.944+0000 7fc330e84640 1 -- start start 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc330e84640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc32c0b3770 0x7fc32c0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc330e84640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c141530 0x7fc32c141940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc330e84640 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32c0b4050 con 0x7fc32c0b91f0 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc330e84640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc32c0b4a60 con 0x7fc32c0b3770 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc330e84640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc32c0b4d40 con 0x7fc32c141530 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc329d9b640 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc32c0b91f0 0x7fc32c0b6750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47606/0 (socket says 172.21.15.33:47606) 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc329d9b640 1 -- 172.21.15.33:0/4146064233 learned_addr learned my addr 172.21.15.33:0/4146064233 (peer_addr_for_me v1:172.21.15.33:0/0) 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc32a59c640 1 --2- 172.21.15.33:0/4146064233 >> v2:172.21.15.155:3300/0 conn(0x7fc32c0b3770 0x7fc32c0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc32ad9d640 1 --2- 172.21.15.33:0/4146064233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c141530 0x7fc32c141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc32959a640 1 -- 172.21.15.33:0/4146064233 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428934001 0 0) 0x7fc32c0b4050 con 0x7fc32c0b91f0 2024-04-25T15:31:13.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.945+0000 7fc32959a640 1 -- 172.21.15.33:0/4146064233 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc318003520 con 0x7fc32c0b91f0 2024-04-25T15:31:13.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.946+0000 7fc32ad9d640 1 -- 172.21.15.33:0/4146064233 >> v2:172.21.15.155:3300/0 conn(0x7fc32c0b3770 msgr2=0x7fc32c0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T15:31:13.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.946+0000 7fc32ad9d640 1 --2- 172.21.15.33:0/4146064233 >> v2:172.21.15.155:3300/0 conn(0x7fc32c0b3770 0x7fc32c0b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.946+0000 7fc32ad9d640 1 -- 172.21.15.33:0/4146064233 >> v1:172.21.15.33:6789/0 conn(0x7fc32c0b91f0 legacy=0x7fc32c0b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:13.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.946+0000 7fc32ad9d640 1 -- 172.21.15.33:0/4146064233 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32c0b42f0 con 0x7fc32c141530 2024-04-25T15:31:13.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.946+0000 7fc32a59c640 1 --2- 172.21.15.33:0/4146064233 >> v2:172.21.15.155:3300/0 conn(0x7fc32c0b3770 0x7fc32c0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T15:31:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.946+0000 7fc32ad9d640 1 --2- 172.21.15.33:0/4146064233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c141530 0x7fc32c141940 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0b4be0 tx=0x7fc32402a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fea0db84ead85ac4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc32959a640 1 -- 172.21.15.33:0/4146064233 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324007740 con 0x7fc32c141530 2024-04-25T15:31:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc32959a640 1 -- 172.21.15.33:0/4146064233 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc3240078e0 con 0x7fc32c141530 2024-04-25T15:31:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc32959a640 1 -- 172.21.15.33:0/4146064233 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324007cd0 con 0x7fc32c141530 2024-04-25T15:31:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc330e84640 1 -- 172.21.15.33:0/4146064233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c141530 msgr2=0x7fc32c141940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc330e84640 1 --2- 172.21.15.33:0/4146064233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c141530 0x7fc32c141940 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0b4be0 tx=0x7fc32402a530 comp rx=0 tx=0).stop 2024-04-25T15:31:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc330e84640 1 -- 172.21.15.33:0/4146064233 shutdown_connections 2024-04-25T15:31:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc330e84640 1 --2- 172.21.15.33:0/4146064233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c141530 0x7fc32c141940 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc330e84640 1 --2- 172.21.15.33:0/4146064233 >> v2:172.21.15.155:3300/0 conn(0x7fc32c0b3770 0x7fc32c0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc330e84640 1 -- 172.21.15.33:0/4146064233 >> 172.21.15.33:0/4146064233 conn(0x7fc32c074060 msgr2=0x7fc32c06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc330e84640 1 -- 172.21.15.33:0/4146064233 shutdown_connections 2024-04-25T15:31:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.947+0000 7fc330e84640 1 -- 172.21.15.33:0/4146064233 wait complete. 2024-04-25T15:31:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.949+0000 7fc330e84640 1 Processor -- start 2024-04-25T15:31:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.949+0000 7fc330e84640 1 -- start start 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc330e84640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b3770 0x7fc32c143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc330e84640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c0b91f0 0x7fc32c147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc330e84640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32c141530 0x7fc32c148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc330e84640 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c141e80 con 0x7fc32c0b3770 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc330e84640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc32c0b3b80 con 0x7fc32c141530 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc330e84640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc32c0b6e60 con 0x7fc32c0b91f0 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc32a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b3770 0x7fc32c143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc32a59c640 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b3770 0x7fc32c143a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40252/0 (socket says 172.21.15.33:40252) 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc32a59c640 1 -- 172.21.15.33:0/3328609215 learned_addr learned my addr 172.21.15.33:0/3328609215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc329d9b640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c0b91f0 0x7fc32c147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.950+0000 7fc32ad9d640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32c141530 0x7fc32c148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc32a59c640 1 -- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c0b91f0 msgr2=0x7fc32c147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc32a59c640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c0b91f0 0x7fc32c147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc32a59c640 1 -- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32c141530 msgr2=0x7fc32c148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc32a59c640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32c141530 0x7fc32c148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc32a59c640 1 -- 172.21.15.33:0/3328609215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32c143f90 con 0x7fc32c0b3770 2024-04-25T15:31:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc32a59c640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b3770 0x7fc32c143a50 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00e990 tx=0x7fc31c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc322ffd640 1 -- 172.21.15.33:0/3328609215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c017070 con 0x7fc32c0b3770 2024-04-25T15:31:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc322ffd640 1 -- 172.21.15.33:0/3328609215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc31c00c9e0 con 0x7fc32c0b3770 2024-04-25T15:31:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32c1dd540 con 0x7fc32c0b3770 2024-04-25T15:31:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc322ffd640 1 -- 172.21.15.33:0/3328609215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00cdd0 con 0x7fc32c0b3770 2024-04-25T15:31:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.951+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32c1ddb00 con 0x7fc32c0b3770 2024-04-25T15:31:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.952+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc32c1dd330 con 0x7fc32c0b3770 2024-04-25T15:31:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.953+0000 7fc322ffd640 1 -- 172.21.15.33:0/3328609215 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc31c01a070 con 0x7fc32c0b3770 2024-04-25T15:31:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.953+0000 7fc322ffd640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc30c0744b0 0x7fc30c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T15:31:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.953+0000 7fc322ffd640 1 -- 172.21.15.33:0/3328609215 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5516+0+0 (secure 0 0 0) 0x7fc31c095070 con 0x7fc32c0b3770 2024-04-25T15:31:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.954+0000 7fc329d9b640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc30c0744b0 0x7fc30c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T15:31:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.954+0000 7fc329d9b640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc30c0744b0 0x7fc30c0769c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc32c139a90 tx=0x7fc314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T15:31:13.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:13.958+0000 7fc322ffd640 1 -- 172.21.15.33:0/3328609215 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc31c05f1f0 con 0x7fc32c0b3770 2024-04-25T15:31:14.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.143+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc32c0764e0 con 0x7fc32c0b3770 2024-04-25T15:31:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.814+0000 7fc322ffd640 1 -- 172.21.15.33:0/3328609215 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) ==== 169+0+0 (secure 0 0 0) 0x7fc31c0634f0 con 0x7fc32c0b3770 2024-04-25T15:31:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.817+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc30c0744b0 msgr2=0x7fc30c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.817+0000 7fc330e84640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc30c0744b0 0x7fc30c0769c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc32c139a90 tx=0x7fc314009040 comp rx=0 tx=0).stop 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.817+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b3770 msgr2=0x7fc32c143a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.817+0000 7fc330e84640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b3770 0x7fc32c143a50 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00e990 tx=0x7fc31c00ee50 comp rx=0 tx=0).stop 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.818+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 shutdown_connections 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.818+0000 7fc330e84640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:6832/794053036,v1:172.21.15.155:6833/794053036] conn(0x7fc30c0744b0 0x7fc30c0769c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.818+0000 7fc330e84640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc32c141530 0x7fc32c148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.818+0000 7fc330e84640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc32c0b91f0 0x7fc32c147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.818+0000 7fc330e84640 1 --2- 172.21.15.33:0/3328609215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc32c0b3770 0x7fc32c143a50 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T15:31:14.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.818+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 >> 172.21.15.33:0/3328609215 conn(0x7fc32c074060 msgr2=0x7fc32c0bd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T15:31:14.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.818+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 shutdown_connections 2024-04-25T15:31:14.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-04-25T15:31:14.818+0000 7fc330e84640 1 -- 172.21.15.33:0/3328609215 wait complete. 2024-04-25T15:31:14.836 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T15:31:14.836 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T15:31:14.836 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:14.850 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T15:31:14.850 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T15:31:14.850 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:14.866 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T15:31:14.866 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T15:31:14.866 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T15:31:14.866 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:14.967 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T15:31:14.967 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T15:31:14.967 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.029 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T15:31:15.029 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T15:31:15.029 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.071 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T15:31:15.071 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T15:31:15.071 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.134 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T15:31:15.135 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T15:31:15.135 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.189 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T15:31:15.189 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T15:31:15.190 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.243 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T15:31:15.243 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T15:31:15.243 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.296 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T15:31:15.296 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T15:31:15.296 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.357 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T15:31:15.357 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T15:31:15.358 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T15:31:15.358 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.382 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T15:31:15.382 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T15:31:15.382 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.408 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T15:31:15.408 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T15:31:15.408 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T15:31:15.408 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.433 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T15:31:15.433 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T15:31:15.433 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.459 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T15:31:15.460 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T15:31:15.460 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T15:31:15.510 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T15:31:15.510 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T15:31:15.511 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T15:31:15.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:31:15.547 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T15:31:16.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:31:16.664 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T15:31:16.908 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:31:16.908 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T15:31:16.998 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:31:16.999 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T15:31:17.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:31:17.117 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T15:31:17.594 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:31:17.595 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T15:31:17.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:31:17.708 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T15:31:17.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:31:17.795 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T15:31:17.869 INFO:tasks.ceph:Archiving mon data... 2024-04-25T15:31:17.870 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/data/mon.a.tgz 2024-04-25T15:31:17.870 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2024-04-25T15:31:17.885 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.xXUSKW7ekL 2024-04-25T15:31:17.885 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.xXUSKW7ekL 2024-04-25T15:31:18.014 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.xXUSKW7ekL 2024-04-25T15:31:18.096 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.xXUSKW7ekL is 271KB 2024-04-25T15:31:18.190 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.xXUSKW7ekL 2024-04-25T15:31:18.206 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/data/mon.b.tgz 2024-04-25T15:31:18.206 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-25T15:31:18.224 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.yG9RhfZuIE 2024-04-25T15:31:18.225 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.yG9RhfZuIE 2024-04-25T15:31:18.352 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.yG9RhfZuIE 2024-04-25T15:31:18.433 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.yG9RhfZuIE is 273KB 2024-04-25T15:31:18.527 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.yG9RhfZuIE 2024-04-25T15:31:18.542 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/data/mon.c.tgz 2024-04-25T15:31:18.542 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-25T15:31:18.596 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.IY3XqrhvLl 2024-04-25T15:31:18.596 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.IY3XqrhvLl 2024-04-25T15:31:18.709 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.IY3XqrhvLl 2024-04-25T15:31:18.789 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.IY3XqrhvLl is 273KB 2024-04-25T15:31:18.883 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.IY3XqrhvLl 2024-04-25T15:31:18.897 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T15:31:18.897 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T15:31:18.900 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T15:31:18.977 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T15:31:19.015 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T15:31:19.015 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T15:31:19.016 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/remote/smithi033/crash 2024-04-25T15:31:19.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T15:31:19.043 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/remote/smithi155/crash 2024-04-25T15:31:19.044 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T15:31:19.077 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T15:31:19.739 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T15:31:19.763 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T15:31:19.788 INFO:tasks.ceph:Compressing logs... 2024-04-25T15:31:19.788 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T15:31:19.806 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T15:31:19.827 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40131.log 2024-04-25T15:31:19.827 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41370.log 2024-04-25T15:31:19.833 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_readonly_test.1809665933.62856.log 2024-04-25T15:31:19.833 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41370.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40131.log.gz 2024-04-25T15:31:19.833 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41032.log 2024-04-25T15:31:19.833 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41370.log.gz 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.libcephfs_readonly_test.1809665933.62856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_path_test.547252180.62856.log 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41043.log 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.libcephfs_path_test.547252180.62856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64391.log 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41032.log.gz 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64181.log 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64391.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41043.log.gz 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42248.log 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64391.log.gz 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.libcephfs_readonly_test.1809665933.62856.log.gz 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64979.log 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64181.log: /var/log/ceph/ceph-client.admin.42248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41369.log 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64181.log.gz 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42248.log.gz 2024-04-25T15:31:19.834 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40568.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41042.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65146.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_user_test.536312463.62856.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41635.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39890.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41364.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41033.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65333.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42542.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40820.log 2024-04-25T15:31:19.835 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65230.log 2024-04-25T15:31:19.836 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41716.log 2024-04-25T15:31:19.858 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42500.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34466.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63352.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62856.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65188.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41636.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41632.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40173.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34202.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40652.log 2024-04-25T15:31:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40299.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64265.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64685.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63909.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64727.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65375.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42038.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64035.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41912.log 2024-04-25T15:31:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42164.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65062.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64517.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40343.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42080.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40522.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41369.log: 87.4%/var/log/ceph/ceph-client.admin.40568.log: -- replaced with /var/log/ceph/ceph-client.admin.64979.log.gz 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42080.log: /var/log/ceph/ceph-client.admin.41042.log: /var/log/ceph/ceph-client.admin.65146.log: 93.6% -- replaced with /var/log/ceph/ceph-client.libcephfs_path_test.547252180.62856.log.gz 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41369.log.gz 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40522.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40568.log.gz 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64223.log 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42080.log.gz 2024-04-25T15:31:19.861 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41042.log.gz 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.65146.log.gz 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.libcephfs_user_test.536312463.62856.log: /var/log/ceph/ceph-client.admin.41635.log: /var/log/ceph/ceph-osd.2.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40522.log.gz 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41635.log.gz 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64223.log: /var/log/ceph/ceph-client.admin.39890.log: /var/log/ceph/ceph-client.admin.41364.log: /var/log/ceph/ceph-client.admin.41033.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64223.log.gz 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 88.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.39890.log.gz -- 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr: /var/log/ceph/ceph-client.admin.41714.log 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41364.log.gz 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41033.log.gz 2024-04-25T15:31:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.65333.log: /var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.42542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65333.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41714.log: 86.4%/var/log/ceph/ceph-client.admin.40820.log: /var/log/ceph/ceph-client.admin.65230.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41714.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42542.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41716.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40820.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42500.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65230.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34569.log 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34466.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42500.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41716.log.gz 2024-04-25T15:31:19.863 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42206.log 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr: 86.9%/var/log/ceph/ceph-client.admin.63352.log: /var/log/ceph/ceph-client.admin.62856.log: -- replaced with /var/log/ceph/ceph-client.admin.34466.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.34569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64475.log 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.65188.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42374.log: /var/log/ceph/ceph-client.admin.41636.log: 88.6%/var/log/ceph/ceph-client.admin.42206.log: -- replaced with /var/log/ceph/ceph-client.admin.65188.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41636.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr: 94.0%/var/log/ceph/ceph-client.admin.41632.log: -- replaced with /var/log/ceph/ceph-client.libcephfs_user_test.536312463.62856.log.gz 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42206.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40173.log: /var/log/ceph/ceph-osd.3.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34569.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41632.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63993.log 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40173.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42332.log: /var/log/ceph/ceph-client.admin.64475.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28376.log 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:gzip/var/log/ceph/ceph-client.admin.63993.log: 91.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.40694.log 2024-04-25T15:31:19.864 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63352.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64475.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.tmp-client.admin.28376.log: /var/log/ceph/ceph-client.admin.34202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63053.log 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40652.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28376.log.gz/var/log/ceph/ceph-client.admin.40299.log: 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40652.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5%/var/log/ceph/ceph-client.admin.40694.log: 88.5%/var/log/ceph/ceph-client.admin.64265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.clear_suidsgid_1587738120.63393.log 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.34202.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63993.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64685.log: /var/log/ceph/ceph-client.admin.63909.log: /var/log/ceph/ceph-client.admin.63053.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64265.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40694.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40299.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1%/var/log/ceph/ceph-client.admin.64727.log: -- replaced with /var/log/ceph/ceph-client.admin.64685.log.gz 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63909.log.gz 2024-04-25T15:31:19.865 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63135.log 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.65375.log: /var/log/ceph/ceph-client.admin.42038.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64727.log.gz 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8%/var/log/ceph/ceph-client.clear_suidsgid_1587738120.63393.log: -- replaced with /var/log/ceph/ceph-client.admin.65375.log.gz 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41633.log 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64035.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42038.log.gz 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.63135.log: /var/log/ceph/ceph-osd.1.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64035.log.gz 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41912.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41912.log.gz 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.63053.log.gz/var/log/ceph/ceph-mgr.y.log: 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41633.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41633.log.gz 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42164.log: /var/log/ceph/ceph-client.admin.65062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64895.log 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42164.log.gz 2024-04-25T15:31:19.866 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65062.log.gz 2024-04-25T15:31:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64517.log: /var/log/ceph/ceph-client.admin.40343.log: /var/log/ceph/ceph-mon.a.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64517.log.gz 2024-04-25T15:31:19.867 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.40343.log.gz 2024-04-25T15:31:19.867 INFO:teuthology.orchestra.run.smithi033.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.clear_suidsgid_1587738120.63393.log.gz 2024-04-25T15:31:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63074.log 2024-04-25T15:31:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64895.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64895.log.gz 2024-04-25T15:31:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40071.log 2024-04-25T15:31:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.63074.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.63074.log.gz 2024-04-25T15:31:19.886 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34478.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34478.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34478.log.gz 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34438.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34398.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mgr.x.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34438.log.gz 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34398.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T15:31:19.887 INFO:teuthology.orchestra.run.smithi155.stderr: 87.0%/var/log/ceph/ceph-mon.c.log: -- replaced with /var/log/ceph/ceph-client.admin.34398.log.gz 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34351.log 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34307.log 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34227.log 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34351.log.gz 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34267.log 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34227.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34307.log.gz 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34227.log.gz 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34518.log 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34518.log: /var/log/ceph/ceph-client.admin.34267.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34267.log.gz 2024-04-25T15:31:19.888 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34518.log.gz 2024-04-25T15:31:19.894 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41041.log 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40071.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40071.log.gz 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40438.log 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41041.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41041.log.gz 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.62856.log.gz 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40438.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40438.log.gz 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42838.log 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41044.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42122.log 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42838.log: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.63135.log.gz 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65280.log 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41034.log 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.65280.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42122.log.gz 2024-04-25T15:31:19.895 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65280.log.gzgzip 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41996.log 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41034.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41034.log.gz 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64811.log 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64937.log 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64811.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41996.log.gz 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64811.log.gz 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63951.log 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64937.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64937.log.gz 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.63951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40480.log 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40387.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63951.log.gz 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40736.log 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40480.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40480.log.gz 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40778.log 2024-04-25T15:31:19.896 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephfs_foo_test.565092874.62856.log 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40778.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40736.log.gz 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40778.log.gz 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64853.log 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.libcephfs_foo_test.565092874.62856.log: 87.3% -- replaced with /var/log/ceph/ceph-client.libcephfs_foo_test.565092874.62856.log.gz 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64349.log 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42458.log 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64349.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64853.log.gz 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64349.log.gz 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64307.log 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42458.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42458.log.gz 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40257.log 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64139.log 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40257.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64307.log.gz 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40257.log.gzgzip 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39967.log 2024-04-25T15:31:19.897 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64139.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64139.log.gz 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63393.log 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64643.log 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.63393.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39967.log.gz 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41715.log 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64643.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64643.log.gz 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41713.log 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41715.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41715.log.gz 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41713.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41713.log.gz 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2024-04-25T15:31:19.898 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mds.a.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.63393.log.gz 2024-04-25T15:31:19.899 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64559.log 2024-04-25T15:31:19.899 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.42290.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2024-04-25T15:31:19.908 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40215.log 2024-04-25T15:31:19.908 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64559.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64559.log.gz 2024-04-25T15:31:19.908 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65022.log 2024-04-25T15:31:19.910 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40215.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40215.log.gz 2024-04-25T15:31:19.910 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41378.log 2024-04-25T15:31:19.910 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.65022.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65022.log.gz 2024-04-25T15:31:19.912 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64433.log 2024-04-25T15:31:19.912 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41378.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41378.log.gz 2024-04-25T15:31:19.912 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41380.log 2024-04-25T15:31:19.913 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64433.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64433.log.gz 2024-04-25T15:31:19.913 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41379.log 2024-04-25T15:31:19.914 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41380.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41380.log.gz 2024-04-25T15:31:19.915 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41372.log 2024-04-25T15:31:19.916 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41379.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41379.log.gz 2024-04-25T15:31:19.916 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41375.log 2024-04-25T15:31:19.917 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41372.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41372.log.gz 2024-04-25T15:31:19.917 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40862.log 2024-04-25T15:31:19.919 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41375.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41375.log.gz 2024-04-25T15:31:19.919 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41040.log 2024-04-25T15:31:19.920 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40862.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40862.log.gz 2024-04-25T15:31:19.920 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65104.log 2024-04-25T15:31:19.921 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41040.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41040.log.gz 2024-04-25T15:31:19.921 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 2024-04-25T15:31:19.922 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.65104.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65104.log.gz 2024-04-25T15:31:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39809.log 2024-04-25T15:31:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.41954.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-04-25T15:31:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64077.log 2024-04-25T15:31:19.925 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.39809.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39809.log.gz 2024-04-25T15:31:19.925 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40029.log 2024-04-25T15:31:19.926 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64077.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64077.log.gz 2024-04-25T15:31:19.927 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63486.log 2024-04-25T15:31:19.927 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40029.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40029.log.gz 2024-04-25T15:31:19.928 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64601.log 2024-04-25T15:31:19.941 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.63486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40610.log 2024-04-25T15:31:19.942 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64601.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64601.log.gz 2024-04-25T15:31:19.960 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64769.log 2024-04-25T15:31:19.960 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.40610.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40610.log.gz 2024-04-25T15:31:19.962 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.b.log: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T15:31:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.64769.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64769.log.gz 2024-04-25T15:31:20.197 INFO:teuthology.orchestra.run.smithi155.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T15:31:20.217 INFO:teuthology.orchestra.run.smithi155.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T15:31:20.593 INFO:teuthology.orchestra.run.smithi033.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.42838.log.gz 2024-04-25T15:31:26.547 INFO:teuthology.orchestra.run.smithi155.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T15:31:27.081 INFO:teuthology.orchestra.run.smithi033.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T15:31:27.436 INFO:teuthology.orchestra.run.smithi155.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T15:31:29.092 INFO:teuthology.orchestra.run.smithi155.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T15:31:30.343 INFO:teuthology.orchestra.run.smithi033.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T15:31:30.356 INFO:teuthology.orchestra.run.smithi033.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T15:31:31.005 INFO:teuthology.orchestra.run.smithi155.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T15:31:31.007 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-25T15:31:31.007 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m11.161s 2024-04-25T15:31:31.007 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m34.133s 2024-04-25T15:31:31.007 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m1.283s 2024-04-25T15:31:33.136 INFO:teuthology.orchestra.run.smithi033.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T15:31:53.382 INFO:teuthology.orchestra.run.smithi033.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T15:32:02.902 INFO:teuthology.orchestra.run.smithi033.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.63486.log.gz 2024-04-25T15:32:02.904 INFO:teuthology.orchestra.run.smithi033.stderr: 2024-04-25T15:32:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:real 0m43.086s 2024-04-25T15:32:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:user 2m1.433s 2024-04-25T15:32:02.904 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m3.658s 2024-04-25T15:32:02.904 INFO:tasks.ceph:Archiving logs... 2024-04-25T15:32:02.905 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/remote/smithi033/log 2024-04-25T15:32:02.906 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T15:32:30.556 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/remote/smithi155/log 2024-04-25T15:32:30.557 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T15:32:35.435 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T15:32:35.445 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T15:32:35.445 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T15:32:35.448 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T15:32:35.533 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T15:32:35.543 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T15:32:35.543 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:32:35.546 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T15:32:35.560 INFO:teuthology.orchestra.run.smithi033.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:32:35.562 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-04-25T15:32:35.566 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:32:35.566 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-04-25T15:32:35.566 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +946us[ +822us] +/- 44ms 2024-04-25T15:32:35.566 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -1182us[-1306us] +/- 53ms 2024-04-25T15:32:35.566 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -225us[ -348us] +/- 75ms 2024-04-25T15:32:35.566 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:32:35.568 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T15:32:35.568 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-04-25T15:32:35.568 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 +959us[ +842us] +/- 44ms 2024-04-25T15:32:35.568 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -1154us[-1271us] +/- 53ms 2024-04-25T15:32:35.568 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -221us[ -221us] +/- 75ms 2024-04-25T15:32:35.568 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T15:32:35.569 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T15:32:35.578 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T15:32:35.579 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T15:32:35.587 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T15:32:35.678 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T15:32:35.741 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:32:35.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:32:35.772 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T15:32:35.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:32:35.799 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T15:32:35.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T15:32:35.840 INFO:teuthology.task.internal:Duration was 1102.778326 seconds 2024-04-25T15:32:35.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T15:32:35.849 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T15:32:35.849 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T15:32:35.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T15:32:35.889 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:32:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T15:32:36.156 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T15:32:36.156 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-04-25T15:32:36.156 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T15:32:36.219 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T15:32:36.219 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T15:32:36.244 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T15:32:36.244 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T15:32:36.261 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T15:32:36.309 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T15:32:36.309 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T15:32:36.328 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T15:32:36.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T15:32:36.456 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T15:32:36.456 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T15:32:36.481 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T15:32:36.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T15:32:36.514 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T15:32:36.523 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T15:32:36.543 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-04-25T15:32:36.566 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-04-25T15:32:36.591 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T15:32:36.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:32:36.611 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T15:32:36.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T15:32:36.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T15:32:36.656 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T15:32:36.657 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/remote/smithi033 2024-04-25T15:32:36.657 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T15:32:36.693 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673205/remote/smithi155 2024-04-25T15:32:36.693 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T15:32:36.724 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T15:32:36.725 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T15:32:36.730 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T15:32:36.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T15:32:36.784 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T15:32:36.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T15:32:36.795 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T15:32:36.795 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T15:32:36.797 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T15:32:36.810 INFO:teuthology.orchestra.run.smithi033.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 15:32 /home/ubuntu/cephtest 2024-04-25T15:32:36.827 INFO:teuthology.orchestra.run.smithi155.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 15:32 /home/ubuntu/cephtest 2024-04-25T15:32:36.828 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T15:32:36.842 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T15:32:36.870 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/libcephfs/{frag test}} duration: 1102.7783257961273 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T15:32:36.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T15:32:36.954 INFO:teuthology.run:pass